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PREFACE | 


HIS is the first major application of the theory of factor analysis 
that was described in The Vectors of Mind.! The study has been 
in progress for several years. When this study was planned, we 
postulated a number of tentative psychological categories or factors 
which served merely to insure that a wide variety of tests of the paper- 
pencil sort were included. The primary factors that appeared have a 
general relation to the tentative categories with which we started, but 
they are not identical with the tentative categories. We had postulated 
-averbal factor, but we found two distinct verbal factors in the analysis. 
We found that the number factor is highly restricted. We had postulat- 
ed different reasoning factors for verbal, numerical, and spatial ma- 
terial; but this tentative classification was not sustained. The reason- 
ing tests revealed two factors that we have called “induction” and ‘‘de- 
duction,’’ the latter being less clearly indicated than the inductive fac- 
tor. These reasoning factors seem to transcend the immediate charac- 
ter of the material of the tests. We had separate tentative categories 
for visualizing in flat space and in solid space, but our analysis did not 
reveal such a division. These tests collapsed into a single visual space 
factor. From the methodological standpoint these findings give strength 
to the factorial methods in that they do not merely reproduce the classi- 
fications that we had in mind. The factorial methods have so far in- 
dicated their effectiveness in testing psychological hypotheses. It is in 
this function that the factorial methods will justify themselves in ex- 
perimental and theoretical psychology. 

Since the completion of this experiment, we have completed another 
experimental study of the perceptual factor? which was not one of the 
tentative categories in the original test material. This factor needs 
much further experimental study before its psychological nature will 
be known. Another experiment is now in progress on the inductive 
factor? which promises to be of fundamental psychological interest. 
These subsequent studies have had the advantage of some orientation 


1, L. Thurstone, The Vectors of Mind (University of Chicago Press, 1935), expanded in 
Multiple-Factor Analysis (University of Chicago Press, 1947). 
2. L. Thurstone, ‘‘The Perceptual Factor,’’ Psychometrika, III (March, 1938), 1-17. 
8. L. Thurstone, ‘Experimental Study of Simple Structure,” Psychometrika, V (June, 
1940), 153-68. 
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about the first seven primary factors as landmarks. Further experi- 
mental studies of the factors will be much more refined and crucial in 
character in that the experimental tests can be constructed more pre- 
cisely to test specific psychological questions. In the exploratory study 
that we are reporting in this monograph we did not have the advantage 
of orientation about any known landmarks. Consequently, the tests in 
the present study were often more complex as to factorial composition 
than we had anticipated. The tests that have been constructed for the 
subsequent studies are more nearly pure in that some of them could be 
designed so, as to feature one factor with little admixture of the others. 
This process will continue for some time until we shall be able to prepare 
psychological tests that involve only one or two factors instead of three, 
four, or five, as 1s the case with most of the tests in current use. 

Experimental work in this field is hampered by the variance of un- 
known nature that is necessarily involved in paper-and-pencil tests for 
groups of subjects. Eventually we shall probably reduce the amount of 
testing in groups with paper-pencil tests and turn to individual tests 
with more refined procedures. At the present state of knowledge it 
is probably better to find the principal landmarks in the cognitive and 
conative primary traits by means of group procedures. When the gen- 
eral nature of the most important primary traits is known, it will be 
possible to design individual tests that are more crucial and incisive 
than can be made at present. The next stage in these developments will 
probably be individual testing with material specially designed to fea- 
ture the primary factors that have been found by the group methods. 
It is our belief that the appraisal of the cognitive and conative primary 
traits will eventually be accomplished in terms of discriminatory and 
other rather simple perceptual tasks with individuals in the laboratory 
and that the tests will look entirely different, superficially, from the 
traits that they may be found to signify. It may even happen that such 
abilities as Number, Induction, and Memory may be appraised by 
tachistoscopically presented discriminatory tasks that do not contain 
any numbers, that do not call for memorizing in the usual sense, and 
which do not involve inductive or deductive thinking in explicit verbal- 
ized form. It seems probable that the various tests for personality traits 
will entirely disappear from the paper-pencil lists. The temperamental 
traits will probably be appraised by the individual differences in cona- 
tive characteristics that may be tested by individual methods. This 
may be one of the most fertile fields for experimental psychological 
study. 
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So far in our work we have not found the general factor of Spearman, 
but our methods do not preclude it. The presence of a general factor 
could be indicated by a large part of the communality of each test that 
remains unaccounted for by the common factors that can be identified 
in asimple structure. So far we have not found any conclusive evidence 
for a general common factor in Spearman’s sense, but some situations 
may be found in which such an interpretation is justifiable. As far as 
we can determine at present, the tests that have been supposed to be 
saturated with the general common factor divide their variance among 
primary factors that are not present in all the tests. We cannot report 
any general common factor in the battery of fifty-six tests that have 
have been analyzed in the present study. 

This study has revealed more problems than it has answered, but the 
new psychological questions that we ask about the primary factors are 
more specific than we could have asked before the primaries were dis- 
covered. The resulting experiments can be planned so as to be more 
crucial and determinate than the exploratory experiment that is here 
reported. 

The computational labor on this study has been much greater than 
in comparable studies that are now being made. The reason is largely 
in the fact that new analytical methods have been tried on the data. 
These efforts have resulted in improved analytical and computational 
methods which are now being used to advantage in subsequent studies. 

In this monograph we have described each of the fifty-six psycho- 
logical tests that were used in the investigation and we have given a 
few sample items from each test to show its nature. The tests have not 
been reproduced in full. For the benefit of those who may want to 
study the tests in further detail we have assembled a limited number of 
sets of tests which are available as a supplement to this monograph. 
The supplement contains full-size copies of all the tests in the battery. 
The supplement may be useful to those who are assembling new test 
batteries for factorial studies in this field. 

I wish to acknowledge financial assistance from the Social Science 
Research Committee of the University of Chicago. A grant for this 
study was made by the American Council on Education, and I am also 
grateful for the financial assistance that has been given by the Carnegie 
Corporation of New York. We were fortunate also to have some 
assistance from the Civil Works Education Service. Special mention 
should be made of the loyalty and interest of my research assistants, 
namely, Miss Leone Chesire, Mr. Ledyard Tucker, Mr. Herbert 
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Landahl, Mr. Robert Blakey, Mr. Thomas Jeffrey, and Mr. Willis 
Schaeffer. Several of them have discovered new theorems and invented 
new laborsaving computational methods in factorial analysis. These 
are being published in separate papers. I must mention also the en- 
thusiasm with which two hundred and forty university students gave 
fifteen hours of time and their sustained interest and effort in taking 
the fifty-six psychological tests. I appreciate the editorial assistance of 
the University of Chicago Press and, in particular, the editorial advice 
of Miss Mary D. Alexander. 

In making an acknowledgment to my wife, Thelma Gwinn Thur- 
stone, I mention not only the customary author’s indebtedness for the 
proofreading. In the entire theoretical development and in the prepa- 
ration of appropriate psychological tests I have depended on her for 
ideas and for psychological judgment which have in large part de- 
termined the present investigation. 

L. L. THuRSTONE 
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CHAPTER I 
THE TEST EXPERIMENT 


INTRODUCTION TO THE MULTIPLE-FACTOR PROBLEM 


HE multiple-factor methods have been developed primarily for 
the solution of some fundamental psychological problems, al- 
though these analytical methods are so general that they will 
probably be found useful as well in solving other problems in the bio- 
logical and in the social sciences. They will be described here in the 
psychological setting in which they were developed. A detailed exposi- 
tion of the factorial methods involves a mathematical treatment of the 
postulates and theorems and of the analysis of experimental data by 
which meaningful factors are isolated. This has been presented in a 
previous volume.’ The purpose here is to present in a relatively non- 
technical form the nature of the factorial methods and the assumptions 
that are involved. The present attempt is to describe the fundamental 
ideas of factor analysis in terms of only the simplest mathematical 
ideas in the belief that some readers who are not interested in the 
mathematical proofs of the previous volume may, nevertheless, have 
some interest to know the essential nature of these methods. 

One of the oldest psychological problems is to describe and to account 
for individual differences in human abilities. How are these abilities 
and the great variations in human abilities to be comprehended? And 
just what is an ability? For centuries philosophers have been free to 
set up arbitrary classifications of personality types and lists of abilities, 
and there have been almost as many classifications as there have 
been writers. The factorial methods have for their object to isolate the 
primary abilities by objective experimental procedures so that it may 
be a question of fact how many abilities are represented in a set of tasks, 
and whether a particular objective performance represents an ability 
that is in some fundamental sense primary. 

This problem can be illustrated by numerous examples. One of these 
is to explain the ability to visualize. Some individuals are described 
as visualizers in their problem-solving, while others are said to be poor 
visualizers. This particular problem was investigated by Sir Francis 
Galton over fifty years ago. The psychological problem is to ascertain 


11, L. Thurstone, The Vectors of Mind (University of Chicago Press, 1935), expanded in 
Multiple-Factor Analysis (University of Chicago Press, 1947). 
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whether the ability to visualize flat form, as in memorizing the detail of 
a design, is the same as the ability to foresee readily how the pieces of 
a jigsaw puzzle are going to fit together before they have been picked 
up. Or does the latter involve some additional kinaesthetic ability? 
And is this sort of visualizing the same ability as that which is required 
to imagine solid objects as they would appear from different sides and 
the ways in which they might fit together? And is this visualizing the 
same ability as that which is required to imagine the movement of solid 
objects as in machine design? These are examples of problems of funda- 
mental interest to psychological science, and if they can be solved the 
results will also be of considerable practical significance. 

Reasoning ability involves similar problems. Is reasoning a simple 
fundamental ability that can operate, as it were, on an indefinite variety 
of things, or is it so highly specific that there is a separate reasoning 
ability for every possible thing that we may reason about? The truth 
is probably between these extremes, but just how specific are the abili- 
ties to reason? How many reasoning abilities are there, and just what 
is each one of them like? Perhaps there is no primary reasoning ability 
at all, so that what we ordinarily call ‘‘reasoning”’ is a complex of more 
elementary powers no one of which can be called ‘“‘reasoning.’’ These 
are but two examples of the types of psychological problems for which 
the multiple-factor methods have been developed. 

These problems will eventually be resolved so that human abilities 
can be comprehended in neurological, physiological, psychological, and 
genetic terms. If one of these sciences should isolate an ability as being 
in some sense primary, it should eventually be possible to identify 
the same ability in terms of the other sciences because there is probably 
no fundamentally sharp line of separation between them. It is quite 
likely that the primary mental abilities will be fairly well isolated by 
the factorial methods before they are verified by the methods of neu- 
rology or genetics. Eventually the results of the several methods of 
investigating the same phenomena must agree. 

The first simplifying assumption of the factorial methods is that, if 
the objective performance of a task requires a certain number of 
fundamental or primary abilities, then the performance can be ex- 
pressed, in first approximation, as a linear function of the primaries. 
The interpretation of a linear function in this context can be illustrated 
by a hypothetical example. Consider an arithmetical task which re- 
quires two hypothetical abilities that may be called “number speed’’ 
and “numerical reasoning.” One subject may be superior in setting up 
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the problems, but he may be slow in the numerical calculation. An- 
other subject may be slow in reasoning out the problem, but he may 
be fast in the calculation. Other subjects may be fast in both, or slow 
in both. In the factorial analysis an objective performance is stated 
as a weighted sum of two contributions, one for each of the two abilities 
that are involved in the task. If the task involves very little calculating 
but mostly reasoning, then the weight for the first factor is smaller 
than for the second factor. The assumption that the performance can 
be regarded as a sum of the contributions of the two abilities 1s repre- 
sented in the expression 


(1) S = AX + Ake , 


in which s represents the standard score of an individual in the arith- 
metical task, 2, and x2 represent the standard scores of the individual 
in the two fundamental abilities, and a, and az are the weights of the 
two abilities in the arithmetical task. If we know to what extent each 
of the two abilities are required in the task, the weights a; and ae, and 
if we know how a person scores in each of the two fundamental abilities 
that are involved in the task, 1 and x2, then the objective performance 
s can be predicted. 

It is conceivable that two individuals with different abilities will 
obtain the same objective performance s. This can be illustrated in 
terms of the present example. If the two weights a; and a2 are com- 
parable so that the task involves both of the hypothetical abilities, 
numerical speed and numerical reasoning, then one of the individuals 
may obtain an acceptable performance if he rates high in x and low 
in x2, while another individual may obtain the same score on the task 
by the opposite configuration of abilities, namely, a low rating 21 
and a high rating x2. The best possible performance is to be expected 
from a person who rates high in both of the abilities that are involved 
in the task. If a task requires only the first ability, then the weight a 
will be high while the weight a2 will be zero. In that case an individual 
who possesses the second ability with a high rating x2 will not profit in 
this particular task because the product a2, will still be zero. In other 
words, the fact that a person has a high rating in a particular ability 
does not help him to superior performance in a task unless the task 
involves the ability in question. 

It may very well happen that the several abilities that are involved 
in a complex task do not enter into the performance in a simple sum- 
mative way. Perhaps the equation (1) should be very much more com- 
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plex. Even if that should eventually be found to be the case, it is fortu- 
nate, nevertheless, that most complex functions can be represented in 
first approximation by a linear expression of the form (1). That is a 
circumstance on which the factorial methods have been built with the 
full realization that the solutions that we obtain will be in the nature 
of first approximations. The factorial methods should enable us to 
ascertain the nature of the principal landmarks in mental ability. Even- 
tually the simple factorial methods will be superseded by more involved 
functions which cannot be written at the present state of knowledge. 
It must be remembered that psychology does not even know if there 
is such a thing as reasoning ability, or visualizing ability, or mental 
speed, or number ability. Some of these abilities have been surmised 
but not objectively proved to be unique and primary mental powers. 
Since none of the primary mental abilities has been objectively isolated, 
we have not been able to appraise individuals as regards their several 
talents or disabilities. 

The weights a; and a2 in the foregoing equation describe the tests, 
while the coefficients x, and x2 describe the individuals. If there are n 
tests and r abilities, the tests may be described factorially in a table 
with m rows andr columns. The rows refer to the tests and the columns 
to the fundamental abilities. Such a table is called a factorial matriz. 

The individual subjects may be described also in a table of coeffi- 
cients in a similar manner. If there are N individuals and if a particu- 
lar experimental study involves r abilities, then the individuals may be 
described in a table with N rows and r columns. Each row describes 
one of the subjects. 

Factorial analysis begins with the record of objective performances 
of individuals, and the problem is to isolate the fundamental abilities, 
to describe their nature, to ascertain the loading of each fundamental 
ability in each test, and to describe each subject as regards each of the 
fundamental abilities. An attempt will be made here to describe the 
logical difficulties involved in solving this problem and the way in which 
these difficulties are overcome. 

If we start with a set of records of the objective performances of 
N individuals in n tests, it is evident that these performances may be 
broken up into parts quite arbitrarily in an infinite number of ways. 
With N individuals and n tests there are nN scores to be acounted for. 
In order that a factorial analysis shall be scientifically significant, 
several restrictions must be placed on the solution. The first require- 
ment is that a scientific explanation must be simpler than the number 
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of things that are to be covered by the explanation. This requirement 
is that the number of degrees of freedom of a scientific hypothesis 
must be smaller than the number of degrees of freedom of the phe- 
nomena that are to be explained. The principle can be treated mathe- 
matically in general form, and it is involved explicitly in statistical 
theory. Most scientists do not deal with this principle explicitly because 
a good scientist uses the principle intuitively. It is almost second 
nature for him in his work. However, in some problems the complexities 
are such that intuitive judgment becomes uncertain, and then an 
explicit treatment of the concept becomes helpful. An absurd ex- 
ample of the violation of this principle is the postulating of a separate 
instinct or mental faculty for everything that people do. A similar 
case is that in which, when a hypothesis fails to be verified in successive 
experiments, it is amended with additional parameters or complexities 
until it becomes so unwieldy that we are left unconvinced and dis- 
satisfied. This is an intuitive application of the principle. In the fac- 
torial problem this principle demands that the scores of the N indi- 
viduals in n tests must be explained with r factors and that the num- 
ber of factors must be smaller than the number of tests. If we must 
postulate a new ability or factor for every new test that is added to the 
experiments, then we have accomplished nothing. It can be proved 
that such a resolution can always be made routinely. This requirement, 
r<n, means that the number of factors must be much smaller than the 
number of tests. 

A reduction of the scores is obtained in terms of the relations between 
une scores of the same individual on different tests and of the relations 
between different individuals on the same tests. These relations give a 
leverage on the problem. The relation between the scores of the same 
individuals on two tests is given by the correlation coefficient. This 
coefficient is a pure number that expresses the degree to which a person 
with high performance in one test tends to make a superior performance 
in a second test. If the correlation is high, then whatever the abilities 
may be in the tests, they are similarly loaded in the two tests. If the 
correlation is zero, then the abilities required in the two tests are so 
different that,.if a man’s performance is known in one of the tests, one 
cannot predict how he would perform in the second test. The raw data 
in terms of which a factorial analysis begins are a square table of corre- 
lation coefficients which shows the degree of similarity of every test 
with every other test in an experiment. Such a square table is called 
a correlational matrix. 
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The number of factors that are involved in the battery of n tests is 
the rank of the correlational matrix. This is a property of the matrix 
which can be determined merely from the coefficients. When the rank 
of the matrix has been determined, it constitutes a partial answer to 
the factor problem, since we know then how many factors or abilities 
are involved in the experiment, but it does not give any information 
as to what the factors or abilities are. The application of this theorem, 
that the number of abilities involved in a set of tests is the rank of the 
correlational matrix, meets with a practical difficulty. In any experi- 
mental situation the correlation coefficients are affected by sampling 
errors so that, if the experiment were repeated, the correlation coeffi- 
cients would not be exactly the same. The corresponding coefficients 
in two similar experiments would differ slightly on account of the 
variable errors. The scientific problem is therefore to find a square 
matrix of coefficients of lowest possible rank that duplicates the ex- 
perimentally observed coefficients within the known sampling errors 
of the experimental coefficients. This problem can be solved in several 
ways. One of the simplest solutions is the centroid method of factoring 
a correlational matrix.? 

The first object of a factorial analysis is to produce a factorial matrix. 
If there are n tests and r factors in an experiment, the factorial matrix 
will have n rows and r columns. Each row describes a test in that the 
entries @1, Q2, @3,...., Show the extent to which each of the factors is 
required by each one of the tests. At this point an interesting inde- 
terminacy appears in the factor problem. While the rank r of the matrix 
of correlation coefficients gives the number of factors in terms of which 
the test scores and the correlations can be comprehended, there is an 
infinite number of ways in which a set of r factors may be chosen to 
explain the tests. A simple analogy to this problem is the situation 
that would arise if we knew the differences between the elevations of 
ten mountains. Even though we had a table showing the difference 
in elevation between every mountain and every other mountain in a 
particular list, the data would give no information as to the absolute 
height of any one of them. 

This indeterminacy constitutes a crucial problem in factor analysis. 
The nature of this difficulty can be shown further in terms of a simple 
geometrical representation of the problem. Figure 1 is drawn to 
represent two tests, (1) and (2), and their intercorrelation. In this dia- 
gram the correlation between the two tests is given by the product of 


? [bid., chaps. ii and iii and Appendix I, and in Multiple-Factor Analysis, chaps. ii and viii. 
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the lengths of the two vectors / and 2 and the cosine of their angular 
separation. A vector is a directed quantity. An example of a vector 
quantity is a force. The strength of the force is represented by the 
length of an arrow, and the direction of the force is represented by the 
direction in which the arrow is pointing. The velocity of an object can 
also be so represented. The speed of the object is shown by the length 
of the vector, while the direction of the motion is shown by the direc- 
tion in which the velocity vector is pointing. Such quantities are dis- 
tinguished from scalar quantities which are not characterized by any 
particular direction. Examples of scalar quantities are price, volume, 
and temperature, which are nondirectional in character. 


FIGure 1 


In the same diagram two fundamental abilities A and B are also 
represented. They are shown at right angles to represent that they are 
uncorrelated fundamental abilities. The test vector (1) may be de- 
scribed as a; of A plus b; of B in a manner similar to the familiar resolu- 
tion of forces in a parallelogram. The second test vector may be de- 
scribed in the same way, namely, as az of A and b2 of B. The inde- 
terminacy appears here in the fact that the two axes A and B may be 
rotated to a new position such as A’ and B’. In this situation the first 
test is described in terms of aj of A’ and bj of B’. These descriptions will 
be entirely different numerically, and the fundamental factors or abili- 
ties would be different in the two cases, but both of these arrange- 
ments account equally well for the intercorrelations of the experi- 
mentally observed values in the correlational matrix. This becomes 
apparent also when it is recalled that in this geometrical representation 
the experimentally observed correlation coefficient is equal to the prod- 
uct of the lengths of the two test vectors and the cosine of the angular 
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separation. But this relation is entirely unaffected by the location of 
the co-ordinate axes A and B or A’ and B’. The indeterminacy con- 
cerns then the choice of a reference frame which is so far entirely arbi- 
trary. 

If there are three factors or abilities involved in the tests of an experi- 
ment, then each test may be represented as an old-fashioned hatpin 
that is stuck into a cork. These hatpins must be so arranged in the 
cork that the experimentally observed correlations between the tests 
are equal to the scalar products of the pairs of test vectors, i.e., the 
product of the lengths of each pair of hatpins and the cosine of their 
angular separation. Such a model can always be constructed if there 
are only three fundamental abilities involved in the experiment. But 
no numerical description can be given for the tests in terms of funda- 
mental abilities until a reference frame has been chosen, i.e., the x, y, 
and z axes. So far as the mathematical problem is concerned, these 
axes can be located arbitrarily, but the scientific problem demands 
that the fundamental abilities which are represented by the co-ordi- 
nate axes shall be uniquely determined and that they shall be meaning- 
ful. 

This indeterminacy has been resolved by discovering another re- 
striction on the configuration that must be found in order that the 
reference frame shall be scientifically meaningful. The factorial matrix 
describes each of the n tests in terms of r fundamental abilities. For 
example, if there are six fundamental abilities involved in an experi- 
ment with fifty tests, then it is not likely that every test requires all 
six fundamental abilities. The factorial matrix would have fifty rows 
and six columns. If the abilities were known, it would probably be very 
difficult to construct a set of fifty tests each one of which required all 
the abilities. It is much more likely that each test will require one or 
more abilities but that these will differ from one test to another. For 
example, if one of the tests calls for the ability to visualize, it is not 
likely that all the verbal tests will contain this ability. If one of the 
tests involves a number factor, it is not likely that all the tests require 
this factor. It is to be expected, therefore, that even for a random 
battery of tests there will be a large number of zero entries in the 
factorial matrix which describes the tests in terms of the fundamental 
abilities. There will be one or more zeros in every row. This circum- 
stance can be capitalized in finding a unique solution for the factor 
problem in which the fundamental abilities shall be simple and mean- 
ingful. 
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This situation is shown in Figure 2, which represents a three-dimen- 
sional configuration of test vectors. Let ABC represent a spherical 
triangle and let O be the origin at the center of the sphere. In the model 
the cork would be at the center, and the test vectors would be repre- 
sented by hatpins. If a test vector lies in the plane AB, the inter- 
pretation is that the test can be described in terms of the fundamental 
ability vectors A and B and that the ability C is not involved in the 
test. All the tests in the plane AB are characterized by the absence of 
ability C. All the tests in the plane BC are characterized by the ab- 
sence of the ability A. A test which contains only one ability such as B 


O 


FIGURE 2 


would lie in the axis OB. If the tests are such that none of them calls 
for all three of the fundamental abilities, then the test vectors lie in 
the three planes AB, AC, and BC, and none of them lies inside the cone. 
Such a model can always be constructed from the observed data if only 
three factors are present in the battery and if none of the tests calls 
for all three of the primary abilities. In this case the three corners of the 
configuration can be seen by inspection, and the reference axes are then 
placed at A, B, and C. The factorial description is the simplest when 
none of the tests requires all three of the fundamental abilities and 
when the number of zero entries in the factorial matrix is maximized. 
Furthermore, if such a configuration is discovered, it necessarily 
means that there is an underlying order in the abilities that are in- 
volved because, if a correlational matrix with rank 3 were written at 
random, the resulting model would show the test vectors scattered 
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over the sphere without any defined pattern, and there would then be 
a limited number of zeros that could be introduced into the factorial 
matrix. When a simple pattern is discovered by which none of the 
test vectors lies inside the configuration and by which a large number 
of zero entries appear in the factorial matrix, the inference must be 
made that an underlying simple order has been discovered in the abili- 
ties. This type of configuration has been called a simple structure or 
simple configuration. In actual experimental work with tests it is not 
often that the number of fundamental abilities is so small as three, 
but analytical methods have been developed for dealing with the same 
problem in any number of dimensions. 

The corners of a configuration as in Figure 2 define the fundamental 
abilities which have been called ‘‘primary abilities.’’ It can be shown 
that the cosine of the angular separation between any two of the pri- 
mary abilities is equal to the correlation between the two primary 
abilities in the experimental population for which the correlations were 
computed. 

When the primary axes have been discovered, it is a problem of con- 
siderable psychological interest to ascertain what each primary ability 
is like. This is done by inspecting the tests which are then known to 
require the primary and the tests in which the primary is known to be 
absent. In case there is uncertainty about the exact nature of a pri- 
mary factor, or in case two rival interpretations are made, it is possible 
by the factorial methods to resolve the question on an experimental 
basis instead of by argument about rival classifications of personality 
as in the past. 

PLAN OF THE TEST BATTERY 

In a previous volume the theory of multiple-factor analysis was de- 
veloped especially for the purpose of isolating primary traits. Several 
smaller studies have been made in order to test the factorial methods, 
but the present experiment constitutes the first major application of 
the methods for isolating primary traits. The experiment was planned 
to include a fairly wide variety of tests covering verbal, numerical, and 
visual tasks in the hope that some of the primary traits involved in 
current psychological tests would appear. 

The present investigation was made with a battery of fifty-six 
psychological tests that were given to a group of 240 volunteers. A 
list of the names of the tests in the battery with code numbers and time 
limits is given in Table 1. In preparing this battery, the tests were 
assembled so as to represent a fairly wide range of the mental activities 
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that are typical in current psychological tests, with special emphasis 
on those tests which are used as measures of general intelligence. It 
was decided to conduct each of the tests in several sections: (1) the 
instructions to the subject with a few examples, (2) a fore-exercise in 
which the subject was given the opportunity to try the task under 
short time-limit conditions, and (3) the test proper. The fore-exercise 
was ignored in scoring since it was regarded as a part of the instructions. 
Its purpose was solely to give the subject a clear idea of what was 
expected in each of the tests. Since current tests are seldom constructed 
in this manner, it was found desirable to construct all the tests specially 
for this study. However, ideas were drawn from current psychological 
tests, and in some cases current tests were adapted to the present test 
program. 

The tests in the battery were grouped roughly according to the abili- 
ties which are called for, but this classification is, of course, only tenta- 
tive since it is the purpose of this investigation to isolate some of the 
primary mental abilities. The tentative groups are given in Table 1, 
but it should be kept in mind that the purpose of this tentative classi- 
fication was merely to insure that each of these descriptive categories 
was represented by several tests. 

In assembling the battery, it was considered essential that various 
types of abstraction be included. Abstraction is represented in verbal 
tests, in numerical tests, and in geometrical and spatial tests. The 
verbal tests were constructed so as to include word associations of 
restricted character as well as the freer forms of verbal and logical 
thinking. The verbal material is.quite extensive so that primary verbal 
abilities should have good opportunity to reveal themselves. 

The geometrical and spatial material was introduced into the tests 
with several problems in mind. It is a psychological question of fact 
whether separate abilities are involved in thinking about flat forms 
which are to be compared as to detail, flat forms which are to be fitted 
as in a form board, solid forms which involve three dimensions, and 
the movement of solid forms in space. It is conceivable that visualizing 
abilities involve all these activities, and it is also conceivable that sepa- 
rate kinaesthetic abilities are introduced by the space tests and by the 
tests in which the subject must think about the movement of solid 
objects in space. Some of the space tests involve reasoning, and it is 
another psychological question whether reasoning involves a distinct 
mental ability which transcends the detailed form on which it is exer- 
cised. Reasoning might appear as several distinct abilities, depending 
on whether it is exercised on verbal, numerical, or spatial material. A 


12 PRIMARY MENTAL ABILITIES 
Table 1 
The Test Battery 
Time Limits 
(In MINUTES) 
Coon NAME OF TEST Scorine FoRMULA 
NUMBER 
Fore- Test 
exercise Proper 
Abstraction: 
Bt id Sal see ed Reading I 4 8 R 
Ape tet vocleiceen Resaingilis tar her 6. Nas cee ts 8 R 
Ole Oe Verbal Classification 5 15 R 
Tees see sae Word Grouping 2 8 R 
Se eed een cee Figure Classification 3 10 R 
Verbal Tests: 
QR ye ee bees Controlled Association 5 16 R (Total number of 
words): 
LOW eee ee ee Inventive Opposites 2 6 R (Total number of 
words) 
Dia ese eee Completion 2 5 
1? eae a Disarranged Words 1 8 R 
jk ar ee ot Te First and Last Letter 5 3,3 | R (Number of words 
accepted) 
ye ee Aes Disarranged Sentences 2 4 R-W 
ta Sel ay eta MN Anagrams 4 10 R (Number of words 
accepted) 
TO Sd ace: Inventive Synonyms 2 6 R 
Space: 
sy Pe rms oe Block Counting 7 ct R 
1 ares ily a8 Cubes 7 5 R-W 
LO Se a ak een Lozenges A 5 4 R 
Oey s eaeue cise Flags 2 2 R-W 
BUR Mie ea es Form Board 3 8 R 
De ie, Heer. Lozenges B 4 5 R-W 
Bo a en an Surface Development 4 6 R-W 
24 es Ree ee Punched Holes 3 3 R 
DUPRE oot ee Mechanical Movements 3 20 R-W 
Form: 
7 RGR N Ca Identical Forms 3 5 R 
PA (mee tet tik: Pursuit 3 3 R 
PL eh ey een ey Copying 4 3 R-W 
QO ee ate tae Areas 5 6 R 
Number: 
BOF Sa ae ee Number Code 5 8 R 
S ile doles ee As ARAGON ule ose keh he tune 3 R 
Mite ne AM Subtraction, fre (prea eee 3 R 
Goes AREAL, Multiplication: ' Whee eehee 3 R 
oh ad Ee tala Divisions ies! oo ee ea er ee 3 R 
OO Ee area Tabular ‘Completion (i) 278 Oe. 10 R 
Numerical Reasoning: 
SG Pere ill Mash Estimating 7 Be tc eke a 
YAS Ae See Pi Number Series 4 10 R 
BS Miter slick We Numerical Judgment 3 10 R-W 
ON oe nt hehe Arithmetical Reasoning i; 20 R 
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Table 1—Continued 


Time LIMItTs 
(in MINUTES) 


aati NAME OF TEST or. Sea ai i a Scorinc FoRMULA 
UMBER 
Fore- Test 
exercise Proper 
Verbal Reasoning: 
BOE ade isso ntder. An: Reasoning 3 6 R-W 
tse > send il hae ie Verbal Analogies 3 6 R 
OA ea ae Ree False Premises 3 8 R-W 
Space Reasoning: 
CS eee Code Words 4 20 R 
Vs inl ea ie Sa Pattern Analogies 3 6 R 
Ns ee eae Syllogisms 3 6 R-W 
Rote Learning: 
BG ese att ba tits Word-Number R 
Page 1 Dh mele aes oi 
Pages 2 and 3 i ot are ae 
Page 4 Dele in gedtta ta ou 
[Seve POLY Oe SM a Lt ail [aan ew lee 5 
Nec oe TE hen Oa aY kann Sete ee Sear 3 
AU ieats Si 33 Initials R 
Page 1 Hs SP) ree eae ems 
Page 2 1, Sau Wb de i a 
Pa gerope mei Oye Pept err hE Oe 6 
LGA? STD I ae ay eee mera 3 
BS ee eh tt Ae Number-Number R 
Page 1 laa dV Be aR 
Page 2 ae sig beet ee bear et Bm 
Gee Re aa eee ey ae 5 
Pacer cee Pe ee mre Peet face ok ane 3 
cS ea Word Recognition R-W 
Page 1 hc Wigntlan as renee 
Page 2 EE A Ie Tete ice 
aC OMe ee ere ha ser 5 
eacerG ern fu Vir) tl ct fake ts 4 
DO oee fees Figure Recognition R-W 
Page 1 SD ie isi de hrc cic Ale 
Page 2 1A Recah is 
Page Ours FIN ae ee 2 
ARCO Mirae, Fuller boost vals 3 4 
a Oe ee Picture Recall 2 9) R 
Unclassified: 
Dee: peels. sx Cie Mae Miah” plch eee has a ee 22 TS EPs ec eRe eee Mera 
5S Oh a oe Hands & 3 R-W 
GY Satta) DER Rhythm 3 6 R 
LSS Ser ea ae A Sound Grouping 3 9 R 
Ung. Go CHI Manan tae ne EB ey: lee a R-W 
Ly Ae ee mee RETR nat Oe ee | eet | ence ae eee 15 Rd 
DOM rs a et Vocabulary (Chicago) |.......... 15 R 
OL Ia ee eae DV Ore OLN Dek dette abe NTs Shaka cea R (Total number of 
words) 


GOste ers eh. WOCHDULAEY Te mee Mb etsy arniac: utes 10 
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considerable variety of combinations of these tentative factors was in- 
troduced into the battery. 

The memory tests were designed within the limitations of paper and 
pencil tests for this program. There was some uncertainty as to whether 
these tests should be named ‘‘memory,” or ‘‘memorizing,”’ or ‘“‘atten- 
tion.” It is a psychological question of fact whether good memory in 
general is a primary ability, whether it is identical with the ability to 
memorize intentionally, and whether this is also the same as the ability 
to give sustained attention to a task or problem. There is also the psy- 
chological problem as to whether immediate memory involves the same 
primary ability as the ability to remember past experience even when 
the subject does not exercise any special intention to retain the experi- 
ence for future recall. These problems are not adequately represented 
in the present battery since they probably call for a special factorial 
study of some magnitude. 


THE SUBJECTS 


When the test battery was being assembled, the question arose of 
how to obtain a fairly large group of subjects who would be willing to 
spend about fifteen hours on the psychological tests. Various proposals 
were considered, such as payment for student service at the usual hourly 
rate and the possibility of obtaining a large group of subjects in various 
types of institutions where people are available with plenty of time and 
not much to do. It was decided to try asking for student volun- 
teers with the promise of an individual report on the findings for each 
student. The present battery of fifty-six psychological tests is probably 
one of the most comprehensive of the test batteries that have so far 
been constructed. It is customary to give vocational and educational 
counseling on test data which are meager in comparison with the indi- 
vidual results that are available for each student who takes the present 
battery of tests. Hence it seemed amply justifiable to offer a free 
service in the appraisal of several mental abilities by the present battery 
as well as it can be done at the present state of knowledge. It did not 
seem fair to ask the subjects to wait until the factorial analysis and 
the extraction of the primary factors had been completed. For this 
reason the subjects were promised a preliminary individual report in 
which the tests were grouped in psychological categories which could be 
justified in terms of current psychological knowledge and practice. 

An announcement was posted on several bulletin boards, and several 
offices were provided with application blanks for the service. The 
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subjects were told that the records of their performances would be 
used in an attempt to isolate the primary mental abilities and that 
they would each be given a preliminary report of the findings as well as 
a final report in a year or two when the analysis of all the records had 
been completed. In the application blank the students were asked to 
give information about themselves on the following points: amount of 
general schooling, name of high school and previous college attendance, 
the college subject of principal interest, fluency in speaking English 
(for the purpose of excluding foreign-born subjects who might be 
handicapped in taking speed tests in English), native country and 
state, expected occupational choice, occupational ambitions, preferred 
avocations, willingness to devote six three-hour sessions to the present 
program of psychological tests, preferred hours, address, and tele- 
phone number. They were told that they would be notified by mail if 
their application was accepted. | 

It was discovered that about one hundred of the applicants were 
willing to devote the mornings of a spring vacation week between 
quarters to the psychological tests, and consequently the tests were 
given in the lecture-room of Eckhart Hall. Other sessions for about a 
hundred students were held in the evenings. Several students missed 
a few sessions, and they were given the opportunity to complete the 
whole program of tests in the following week. Announcement was 
made that no student’s tests would be scored unless he had completed 
the whole program of fifty-six tests. The interest of the students in the 
tests was remarkable. Instead of regarding the tests as a disagreeable 
chore, the subjects seemed to enjoy them, and comments to this effect 
were frequent. The examiners had the opportunity during an inter- 
mission at each session to talk with the students and to discover their 
reactions to the tests. The subjects worked with intense interest and 
effort during the full time limit for each test. This was a fortunate cir- 
cumstance because it implied that the score of each man could be taken 
safely to represent his performance under considerable pressure of 
motivation and interest. The subjects finished the fifteen hours of 
testing with applause. At the end of the last session the writer ac- 
knowledged again the assistance that the students had given toward 
the solution of a problem of fundamental importance to science as 
well as to practical affairs. They were promised preliminary indi- 
vidual reports in line with the best knowledge then available and 
individual final reports when the factorial analysis was complete. The 
success of the undertaking so far shows clearly that studies of this kind 


16 PRIMARY MENTAL ABILITIES 


can be made with volunteers and that the original problem of how to 
get subjects willing to be tested for fifteen hours had been satisfactorily 
resolved. 

The total experimental group consisted of 240 volunteer subjects, 
and 218 (91 per cent) finished all five sessions. This group includes 40 
students at the Central Y.M.C.A. College who volunteered as sub- 


Table 2 
Age Distribution of Subjects 


Age | 16 | 17 |. 18) 9197) 920)" 21,|\ 224 23° 4eea | ogee 
f 9 e987) borzl| fags 8051 9h ete iegelee sa ieees tite 
Table 3 


Psychological Examination of the American Council 
on Education 


NatTionaLt Norms 
UNIVERSITY OF CHICAGO 


(1933) 
Baier: Se 203 CoLLEGES 
Gross Score N =40,229 
Pat x2 122-154 x1 
LS oe i ey 05 —1.64 28 — .58 
1 Be aera ae 10 —1.28 42 — .20 
1 SY GCM See ee 15 —1.04 .5ol 03 
TOO Ss ote eae 20 — .84 .58 20 
Mh/6Reros oe 25 — .67 .63 33 
1 bo Ns en eee 30 — 52 .67 44 
1S Re ORCS aes 35 — .39 71 55 
ZO: 40 — .25 .76 whl 
DOO Fc 8 Grea seaihs 45 — .13 79 .8l 
DSc meer cee ae .50 .00 . 83 .95 
Did Serer Eee aa eet .55 .138 . 86 1.08 
vis Ae Dat feat Aone .60 25 .88 Dek], 
ZOO LN aes tae .65 39 .90 1.28 
DAS ig ie ate .70 52 .92 1.41 
ZOD seca caus: rho 67 .94 1255 
Pad: SCORN ae ard A .80 84 .95 1.64 
2 Osean. vais ae .85 1.04 97 1.88 
ZOE a ea re .90 1.28 OST el Reh erence 
SOS). ea .95 1.64 OO he AR eh ea ie: 


jects. The experimental group was divided as follows: 132 Freshmen, 
36 Sophomores, 30 Juniors, 12 Seniors, and 14 college graduates. The 
age distribution is shown in Table 2. The modal age was 18. 

The subjects in the present study were a highly selected group. The 
fact that they volunteered for the experiments probably accounts in 
part for the fact that their average mental endowment was exception- 


THE TEST EXPERIMENT 17 


ally high. It is of theoretical interest to ascertain whether they con- 
stituted a normal distribution of test intelligence in terms of standards 
that are available for larger populations. It was found that 113 of the 
240 subjects had previously taken the psychological examination of the 
American Council on Education. On the assumption that these 113 
students were representative of the entire group of 240, it is possible 
to compare the subjects in this investigation with the Freshman 
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National Norms 
FIGURE 3 


classes at the University of Chicago and with the national norms on 
the same examination for 203 American colleges. 

In Table 3 are recorded the data for comparing the Chicago Fresh- 
men with the national norms.’ The raw scores in the table were selected 
so as to correspond with percentile ranks in intervals of .05 for the 
Chicago Freshmen. The corresponding z-values are the deviations of a 
normal distribution in terms of its standard deviation. A similar 
tabulation is made for the national norms for the same raw scores. 
Figure 3 shows the plot of the two z-values for the same raw scores. 


3. L. Thurstone and Thelma Gwinn Thurstone, “The 1933 Psychological Examina- 
tion,” Educational Record, XV, No. 2 (April, 1934), 173. 
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The linearity of the plot proves that the two distributions may be 
regarded as normal distributions on the same absolute scale of test 
ability.‘ 

The fundamental scaling equation is 


(2) M: + 2202 = My, + 2101 ) 


in which M, and M; are the absolute means and o, and a; are the abso- 
lute dispersions. The equation may be written in the form 


(3) eM ee Cees 
02 02 
The equation of the linear plot is 
(4) @, = 1,122, — 1.04, 
and hence the slope is 
a1 
(5) es 
and the x-intercept is 
(6) M, — Mz = —1.04. 
C2 


The national norms show the greater variability, and the difference 
between the two means is 1.04 o2 on the Chicago distribution. 

A similar comparison was made between the national norms and the 
group of 113 subjects in the present study for whom American Council 
test records were available. Table 4 shows the numerical comparisons, 
and these are represented in Figure 4. Here the fundamental scaling 
equation is 


(7) M3;+ 2303 = M1 + 2101, 
which may be written in the form 


(8) oe pec 
3 


03 
The equation of the linear plot is 


(9) 23 = 1.19%, — 1.63. 


*L. L. Thurstone, “A Method of Scaling Psychological and Educational Tests,” Journal 
of Educational Psychology, XVI, No. 7 (October, 1925), 433-51. 
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The slope, 1.19, is the ratio of the dispersions of the two groups. The 
national norms show the greater dispersion. The additive term, 1.63, 
is the difference between the two means in terms of the standard devia- 
tion of the experimental group. The linearity of the diagram proves 
that these two distributions may also be regarded as normal distribu- 
tions on the same absolute scale of test ability. 


Table 4 


Psychological Examination of the American Council on Education 


NatTionaLt Norms 


(1933) Test Sussects Havine A.C.E. Recorps 
N =40,229 N=113 
203 CoLLEGES 
INTERVAL 
P.R. Upper P3 Upper 
Boundary “2 M1 Boundary oe 

Boe AUG vie ans Heke .40 — .25 1 a) RO, eee oe) | 
AQ s eon .45 — .13 2 OL) Mien Paton ee ae 
MEE OE eecresy sce eo ig .50 .00 4 04 —1.75 
8 na eae ae 00 .13 6 05 —1.64 
Ps, aie Sine ik .60 o20 10 09 —1.34 
60-.65.......... 65 .39 16 14 —1.08 
GO 1 62s hacks .70 we 18 16 — .99 
Ud Ones eva ia ay 5 .67 22 19 — .88 
BOF POU eyo W hon .80 . 84 32 28 — .58 
SO Sore ie kee boon 85 1.04 38 34 — .41 
BSP is ee ees 90 1.28 48 42 — .20 
Dok!) re Oe 95 1.64 73 65 39 
O5—J9Go Se oes 3. 96 1.75 76 67 44 
OG OTR bis. beds .97 1.88 80 71 55 
UF ak! lo eee Bo cot ELA IIRL Nee | i a 83 73 61 
Oe Lbs co'sin® ahaes i AH ai lol aan tia rite 89 79 81 
99-.999......... ee RAEN Dee eae ee Eee 112 OES a) Ware Atte 
Ea Sher ee eh [eclecuacs Ges gga ee 113 ros ek ate ees 


In Figure 6 the three distributions have been superimposed on the 
same absolute scale. The three curves show the relation between the 
national norms which represent 203 American colleges, the Freshman 
class at the University of Chicago in 1933, and 113 of the subjects in 
the present study. The linearity of the relations in Figures 3 and 4 is 
conspicuous, and it is especially convincing for the applicability of the 
absolute scaling method. This analysis supports the conclusion that 
the group of subjects in this study constituted a normal distribution of 
test intelligence on the same absolute scale on which the distribution of 
40,229 Freshmen in 203 American colleges is normal. The relation be- 
tween these two distributions is shown in the comparison between 
curves / and 3 in Figure 8. 
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ADMINISTRATION OF THE TESTS 


It was at first planned to give the tests in six sessions, but it was 
found possible to complete the entire test battery in five sessions of 
about three hours each. An intermission of about ten minutes was 
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FIGURE 4 


given in the middle of each session. The tests were given in the fol- 
lowing order in the several sessions: 


Session 
1: Tests 26, 4, 5, 17, 6, 27, 30, 46, 9, 25 
2. Tests 28, 10, 36, 11, 53, 12, 18, 43, 19, 47, 20 
3. Tests 29, 13, 37, 21, 14, 40, 22, 41, 23, 48, 7 
4, Tests 15, 8, 42, 16, 24, 49, 54, 55, 38, 44 
5. Tests 51, 31, 32, 33, 34, 56, 50, 39, 45, 58, 59, 60, 35, 57, 52 


In arranging the order of the tests, an attempt was made to vary the 
nature of the material as regards verbal, numerical, and visual content 
so as to minimize fatigue or boredom with repetition of the same type 
of mental activity. The tests were administered to three separate 
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groups of not more than one hundred students in each group. Each 
test with fore-exercise was bound in a separate pamphlet. The pam- 
phlets were distributed and collected separately for each test by ten 
or twelve examiners. This interruption between tests serves the useful 
function of avoiding the continued strain which would result if a long 


! National Norms 
2 University of Chicago Freshmen 
3 Experimental Group 


=3 ~2 a 0 1 2 3 


Ficure 5 


series of tests were bound together in the same booklets and if the ter- 
mination of one test were followed immediately by the beginning of 
the next one. To handle the tests in separate pamphlets takes more 
time and more examiners, but it is probably a better procedure. It in- 
troduces an interruption between successive tests in the form of a 
natural rest of a few minutes between the time limits of the tests. 


CHAPTER II 
DESCRIPTION OF THE TESTS 


HE tests will be described in the order of their code numbers 

listed in Table 1-7. Each test is illustrated by a few sample items. 

In many cases the sample items are taken from the instructions 

and the fore-exercise. The complete set of fifty-six lithographed tests 
has been published as a supplement to this monograph. 

Reading I (4) and Reading II (5).—These tests were prepared by the 
author, for use at Carnegie Institute of Technology in 1919, with the 
assistance of Miss Helen Davis. Both of these tests were used in the 
present battery in their original form. They have been used by Pro- 
fessor E. L. Thorndike as a part of the tests known as the “CAVD” 
tests. Both of these tests were planned as tests of reading in which the 
subject should return a fairly large number of objective responses in a 
limited time. Since the tests call for the interpretation of proverbs 
and of quotations with paraphrased statements, they have the advan- 
tage that the subject does not merely repeat the statements in the 
tests. He must interpret their meaning in order to make correct re- 
sponses. There is a short fore-exercise which is followed by the test 
proper. Since the second reading test uses the same plan with quota- 
tions instead of proverbs, no special instructions or fore-exercises are 
needed for Reading II. 


SAMPLES FROM READING I (24 ITEMS) 
This is a test of your ability to understand what you read. Read proverb A. 


A. Sail when the wind blows. 

Two and only two of the following sentences have nearly the same meaning as 

proverb A. Find these two sentences. 
__v__ Strike when the iron is hot. 

One must howl with the wolves. 
__v__ Make hay while the sun shines. 
Make not your sail too large for the ship. 

The first and third statements have been checked because they have nearly the 
same meaning as proverb A. 

Now check the two sentences in the group below which have nearly the same mean- 
ing as proverb B. 


1]. L. Thurstone, Psychological Tests for a Study of Mental Abilities (University of Chi- 
cago Press, 1937). Available on microfilm from American Documentation Institute, 1719 
N Street, N.W., Washington 6, D.C. 
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B. Tall oaks from little acorns grow. 


No grass grows on a beaten road. 

Large streams from little fountains flow. 
The exception proves the rule. 

Great ends from little beginnings. 


SAMPLES FROM READING II (25 ITEMS) 


1. “In calamity any rumor is considered worth listening to.”— 
PUBLIUS SYRuvS. 


A drowning man grasps at a straw. 
Rumors are seldom truthful. 

Thy neighbor is thy teacher. 

Any port is welcome in a storm. 


. “No great genius was ever without some mixture of madness, nor 
can anything grand or superior to the voice of common mortals be 
spoken except by the agitated soul.””—ARISTOTLE. 


Genius is essentially hard work and persistence. 
Contented and serene characters are the ones that pro- 
duce the work of genius. 

Genius and insanity have certain elements in common, 
Strokes of genius are likely to come after times of great 
disturbance or stress for the individual. 


Verbal Classification (6) was prepared by Thelma Gwinn Thurstone. 
The intention was to devise a verbal form of test which called for the 
same type of classification as the geometrical forms in Spearman’s test 
(8) for “‘g.”’ This test was prepared to parallel Spearman’s classifica- 
tion test with verbal material. In preparing several tests for the same 
ability, it is quite likely that variation in difficulty will cause the test 
to require different abilities. The present Verbal Classification test is 
probably easier than the Figure Classification test of Spearman. The 
tasks are similar in kind except for the substitution of words for figures. 


SAMPLES FROM VERBAL CLASSIFICATION (70 ITEMS) 


Column 1, below, is a list of animals. Column 2 is a list of furniture. Column 3 has 
some words about animals and some words about furniture. Desk is furniture, and 2 is 
written after it. Sheep is an animal, and 1 is written after it. The rest of the words 
under 3 have been marked in the same way. 


1 2 3 
cow table desk Pin 
horse chair sheep ets 
bird bookcase rocker _2_ 
dog lamp dresser __2 _ 
cat pees 
ieee 


donkey 


24 PRIMARY MENTAL ABILITIES 


Below is another problem of the same kind. Column 1 is a list of colors, and column 2 
is a list of sports. The first few words under 3 have been marked for you. You mark 
the others. 


1 2 3 

blue golf red seid un 
green tennis pink pal ee 
violet football baseball nae 
yellow swimming diving i ae 

orange pinot 

purple oa see 

In the following problems, mark each word under 3. 
1 2 3 

mountain profound upward Rusad eed 
tower submerged depression me 
mast pit surmount {uit bi 
aloof dive soar Soames 

depth een Dae 

sunk Ps 
simple barnstorm charming Ma 
tasteful gaudy roar ie Eins 
celestial torn panic ne vesbe, 
chaste driven classic fo Bieta 

crazy pueeeee 

pure eae 
lacerate suffer wince genet 
torture ache crucify irate 
bite twinge crush fate sees 
pinch writhe smart pa eure 

moan ee 

cut eee 


Word-grouping (7) was prepared by Thelma Gwinn Thurstone. It is 
similar to a form of test in current use and is intended to be suitable for 
college students. Since the task is quite simple to comprehend, the in- 
structions and the fore-exercise are combined in the first page, which is 
followed by the test proper. 


SAMPLES FROM WORD-GROUPING (71 ITEMS) 


In the line below, notice that the four words, dog, lion, cat, and giraffe, can be 
grouped together because they are all names of animals. The word chair does not belong 
with the others because it is not the name of an animal. Since chair is the second word, 
2 is written in the blank at the right. 


1—dog 2—chair 3—cat 4—lion 5—giraffe 2 
Similarly, four of the words in the line below can be grouped together because 


they are alike in some way, while one of the words does not belong because it is dif- 
ferent. Write the number of that word in the blank at the right. 


1—carrot 2—radish 3—beet 4—book 5—turnip —___ 
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Book does not belong because the other four are all vegetables. You should have 
written 4 in the blank. 

In each of the lines below, find the four words which can be grouped together because 
they are alike in some way. Then write the number of the extra word in the blank at 
the right. 

1—aunt 2—uncle 3—barn 4—mother 5—father W—— 


1—paper 2—chisel 3—axe 4—knife 5—saw eae 


1—lake 2—ocean 3—sea, 4—oulf 5—field fees 
1—youth 2—boy 3—man 4—maiden 5—girl he Ss 
1—run 2—swim 3—walk 4—march 5—hike 


Figure Classification (8) is part of a test used by Professor Charles 
Spearman and has been reproduced in this battery with his permission. 
It was included because, according to Professor Spearman, it is one of 
the best tests for his central intellective factor ‘‘g,” and it was of course 
desirable to have that factor well represented in this battery. The test 
was arranged with one page of instructions and examples, which was 
followed by a two-page fore-exercise. Then followed the test proper in 
the next eight pages. 


SAMPLES FROM FIGURE CLASSIFICATION (28 ITEMS) 


In each line below, there is a rule by which the symbols in Group I differ from those 
in Group II. There is a new rule for each line. Your problem is to discover the rule in each 
line. Some sample problems are worked for you below. 

In the first line below the rule is that the symbols in Group I are horizontal while 
those in Group II are vertical. Each of the test symbols at the right belongs either to 
Group I or to Group II. The test symbols that belong to Group I have been checked. 


GROUP I GROUP II TEST SYMBOLS 


Ol 0 


The rule in the problem below is that the figures in Group I are closed while those 
in Group II are open. Now check the test symbols that belong to Group I. 


GROUP I GROUP II TEST SYMBOLS 


You should have checked the third and fourth symbols. They are closed figures. 
Now find the rule in the following line by which Group I differs from Group II. 
Then check the test symbols that belong to Group I. 


GROUP I GROUP II TEST SYMBOLS 


You should have checked the second and fourth symbols. They are shaded. 
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GROUP I GROUP II 


Controlled Association (9) was prepared as a test of word fluency. It 
is intended to appraise the ability to produce a large number of relevant 
word associations. For this reason it was not written in the objective 
form. There may be a difference in the facility with which a subject can 
check relevant items already given and his facility in producing rele- 
vant associations. The instructions and fore-exercise are combined 
in the first page of the test. 


SAMPLES FROM CONTROLLED ASSOCIATION (8 SECTIONS) 
This is a test of your ability to think of words. Several words have been written 
in the blank space after the word ‘‘coop.”’ Read them. 
GOOD: 
Notice that all the words written above are somewhat like the word ‘“‘coop’’ in 
meaning. 
In the blank spaces below write as many words as you can which have somewhat 


the same meaning as the given word. You may use slang or foreign words. Go right 
ahead. 

Write words similar 

in meaning to \ 

HAPPY: 


Write words similar 
In meaning to 


LARGE: 
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TEST SYMBOLS 


Inventiwe Opposites (10) was prepared on a plan similar to that of 
Controlled Association. In the opposites test the subject is asked to 
produce two opposites for every given stimulus word. The initial letter 
of the response word is given. The opposites test in this form is likely 
to feature verbal fluency more than the opposites test which involves 
only checking one of several given response words. However, this is a 
question of fact, and it is the object of the present study to determine 
whether verbal fluency is a primary ability distinct from other abilities. 


SAMPLES FROM INVENTIVE OPPOSITES (30 ITEMS) 


This is a test of ability to think of words. Think of two different words opposite 
in meaning to the word narrow below. One word should begin with 6. The other 
should ew with w. The words are broad and wide. These words have been written 
in the blanks. 


narrow b cy eS aot We secre Ae 


Now think of two words opposite in meaning to the word large. The first should 
begin with /; the second with s. 


large | lect RE Ns ei See eee 
The words are little and small. Write little in the first blank. Write small in the second. 
strong Le Pa ae ee te Ww 
wrong Pee ee er c 
dark Dye ng ae Pe l 


Completion (11) was adapted from the Completion tests that have 
been used in the Psychological Examination of the American Council on 
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Education. It is one form of vocabulary test in that a definition is given 
and the subject is asked to supply the word. He is given the initial 
letter of the response word. It is likely that this test combines vocabu- 
lary and verbal fluency, if these are distinct abilities. 


SAMPLES FROM COMPLETION (389 ITEMS) 


There is one word missing in each of the following sentences. The first letter of the 
missing word is shown in the parentheses. 
A icontest of Speedie Aae.dcm. ce eye ee (rt) Agee ee 
In order to complete the sentence we have written the word race in the blank space. 
The two sentences bélow are completed correctly. 
A-fluid used dnewriting 1s. +442 sea Riegp tes (i) cede) a 
‘A ishortsleep 01. d076.16: 4.2 eae ees (n) 
Complete the following sentences in the same way. The word you use must begin 
with the letter shown in parantheses. 


A person licensed to practice medicine is a..... (d) 
A cap used in sewing to protect the finger when 
pushing the needle.is.'a... 5......%25.5-3-- t 


The red fluid that circulates in the veins and 
arteries Oldman lS. k: ccs oe ae eee 
The part of the day between noon and evening 


Disarranged Words (12) is similar to a form of test in current use. 


SAMPLES FROM DISSARRANGED WORDS (72 ITEMS) 


Rearrange the letters on each of the following lines to spell the name of an animal. 
In the first line, the letters (ebar) can be arranged to spell bear, which is written in the 
blank. space. In the next line, the letters (odg) spell dog, which is written in the blank 
space. In the same way the letters (atc) spell cat. 


ANIMALS 
ebar Sey 
odg nog 
ate lak 


Rearrange the letters on each of the following lines to spell the name of a boy. The 
first two names have already been written for you. Write the third. 


BOYS’ NAMES 


lpau Bal 
rela Cark 
hon] 
Rearrange the letters on each of the following lines to spell the name of a bird. 
BIRDS 
uckd 
cowr 


wahk 
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First and Last Letter (13) was devised by Thelma Gwinn Thurstone 
as another test of the facility with which words come to mind. The 
subject is given the first and last letter and asked to write as many 
words as possible that have the given initial and terminal letters. There 
are marked individual differences in this ability. 


SAMPLES FROM FIRST AND LAST LETTER 


In the blanks below, write as many different words as you can that begin with S, 
and end with L. The words may be long or short. You may write the names of persons, 
or places or foreign words. Errors in spelling will not be counted against you. 

As examples, the first three lines have already been filled in for you. Write as many 
other words as you can. 


Write words that 
begin with S and end with L. 


Tae 
Dee a7. 


3. paebile 


Disarranged Sentences (14) was assembled from several forms of the 
Army Alpha tests. 


SAMPLES FROM DISARRANGED SENTENCES (81 ITEMS) 


In the sentence below the words are mixed up. When the words are put in the right 
order, they read, ‘‘Chicago is a large city.” This statement is true. Therefore a plus 
sign (+) is written in the parentheses. 

(+) Chicago large a city is 

If the words in the next sentence are put in the right order, they read, ‘“The dog is 
a rare animal.” This statement is false. Therefore a minus sign (—) is written in the 
parentheses. 


(—) animal a is the rare dog 
Below are three more sentences which have been marked correctly. 
(+) eyes some brown are 
(—) blue human is usually hair 
(—) of is green made moon cheese the 
Mark the following sentences yourself. Put a plus sign (+) in the parentheses if 
the sentence is true. Put a minus sign (—) if it is false. Do not take time to write out 
the sentence in the correct order. 
white blackboard the is 
is falling rain water 
fly some can birds 
blue is sky the sometimes 
an never dies evergreen 
large is an beast ant-a 


NaN NS NON BIN 
NY NY’ NS SY’ WS] WS 
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Anagrams (15) is similar to current tests of the same name. 


SAMPLES FROM ANAGRAMS 


Make as many different words as you can, using only the letters in the word 
G-E-N-E-R-A-T-I-0-N-S. You may use long or short words and may include the names of 
persons, places, or foreign words. In any one word do not use a letter more times than 
it appears In G-E-N-E-R-A-T-I-O-N-S. 

Sample words have been written in the first few lines. Continue writing as many 
words as you can using only the letters given. 

G-E-N-E-R-A-T-I-O-N-S 
Awe 


LLG 


aa seh a 


SR ee ee ae 


Inventive Synonyms (16) is arranged in a manner similar to that of 
Inventive Opposites in that the subject is asked to supply two syno- 
nyms for each stimulus word and is given the initial of each of the re- 
sponse words. 


SAMPLES FROM INVENTIVE SYNONYMS (29 ITEMS) 


This is a test of ability to think of words. Think of two different words that mean 
the same as the word tiny below. One word should begin with s. The other should 
begin with 1. The words are small and little. These words have been written in the 
blanks. 


tiny 8, atonal l. ahey ee eee 


Now think of two words that mean the same as aid. The first should begin with h; 
the second with a. 


aid hee eee oe a 


ae words are help and assist. Write help in the first blank. Write assist in the 
secon 


Go ahead with the exercises on this page. For each word that is given write two 
other words of similar meaning. The words must begin with the letters indicated. 


huge eee ee ] 
possess | oN Edu All alk oO 
infant Gud oe Ne, Sateen b 


Block-counting (17) was adapted from one of the tests of Professor 
T. W. MacQuarrie. The present form has been made longer, but the 
items are of the same character. It should be a good test of visualizing 
in solid space, and it gives a large number of independent responses in 
a relatively short time. The instructions and fore-exercise were com- 
bined on the first page of the test. 
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SAMPLES FROM BLOCK-COUNTING (16 PROBLEMS) 


Figure 1 represents a pile of blocks. All of them are the same size and shape. The 
block A touches four other blocks (B, C, D, and E). Therefore we have written 4 
after A in the column to the right. Block B touches two other blocks. Therefore 2 is 
written after B in the column to the right. Block C touches 4 other blocks and 4 is 
written after C. The rest of the column is marked in the same way. 


Fill in the blank spaces to show how many blocks touch each of the lettered blocks. 
The blocks are all of the same size and shape. 


Cubes (18) is an adaptation of a more difficult form of test that has 
been used by Professor Carl C. Brigham in experimental tests for the 
College Entrance Examination Board and is described in A Study of 
Error.? This is probably the most difficult of the space tests in the pres- 
ent battery. The instructions and fore-exercise are given on separate 
pages with separate time limits in order that the subject may be care- 
fully introduced to the exact nature of the task. 


SAMPLES FROM CUBES (32 PROBLEMS) 


The drawings in this test represents cubes. There is a different design on each face 
of the cube. A cube has szx faces. 

Notice that both of the drawings below can represent the same cube. Be sure you see 
that the first and second drawings represent the same cube turned into two different positions. 
Since both drawings can represent the same cube, a plus sign (++) has been placed in 
the blank square at the right. 


te 


2 Carl C. Brigham, A Study of Error (New York: College Entrance Examination Board, 
1932). 
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Notice that the two drawings below represent two different cubes and that a minus 
sign (—) has been placed in the blank square at the right. Be sure that you see that it 
would be impossible to turn the cube shown in the first drawing so that it would look EX- 
ACTLY like the cube shown in the second drawing. Unless you see this clearly, you 
cannot solve the test items. There is a different design on each face of the cube. 


OKs 


If the two drawings below can represent the same cube turned into different posi- 
tions, put a plus sign (+) in the square at the right. If the two drawings below cannot 
represent the same cube, put a minus sign (—) in the blank at the right. Remember 
that there is a different design on each face of the cube. 


Of <n 


You should have marked the above problem minus (—). Study it carefully to be 
sure you see that this is true. 
Now mark the problem below. 


PoIc 


You should have marked the above problem plus (+). 


In the following practice problems put a plus sign (++) if the two drawings can both 
represent the same cube. Put a minus sign (—) if they cannot both represent the same 
cube. Remember that there is a different design on each of the six faces of a cube. 


Lozenges A (19) was prepared by the author at Carnegie Institute of 
Technology. The purpose of this test was to introduce kinaesthetic 
imagery into a paper-pencil test without involving mechanical devices. 
It is quite likely that kinaesthetic imagery is involved in this test for 
most people and that it also involves large loadings of one or more 
visualizing factors. 
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SAMPLES OF LOZENGES A (48 ITEMS) 


Figure 1 represents a lozenge-shaped card. It has a hole in one corner. It is painted 
black on one edge. Imagine that it is picked up, turned over, and placed face down so 
that the black edge touches the long black line in Figure 2. Decide which of the two 
diagrams it would fit. Where would the hole be? It is shown in Figure 2. 


| Sy a 


Fia. 1 Frea2 


In each of the other three sample problems imagine that the card is picked up, 
turned over, and placed face down so that the black edge touches the long black line. 
Decide which of the two diagrams it would fit and where the hole would be. In each of 
these examples a small circle has been drawn to show where the hole would be. 


Bey ae 
Pi Lich as \ 


For each of the following problems decide which of the two diagrams the card would 
fit when it has been turned over and draw a small circle to show where the hole 
would be. The first two problems below have been marked for you. 


Flags (20) was prepared by the author at Carnegie Institute of Tech- 
nology in studies of visualizing. This is one of the simplest of the visual- 
izing or space tests in this battery and probably does not involve so 
much kinaesthetic imagery as the Lozenges test. 
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SAMPLES FROM FLAGS (48 ITEMS) 


Look at the two flag pictures below. They represent opposite faces of the same flag. 
A minus sign (—) has been placed in the square to indicate that the pictures show oppo- 
site faces of the flag. 


Now compare the next two pictures. If they represent the same face of the flag, 
mark them plus (+). If they represent opposite faces of the same flag, mark them 
minus (—). 


The two pictures show the same face of the flag, so a plus sign (+) should be written 
in the square. 

Mark in this way each of the following pairs of flag pictures. If the two pictures 
shows the same face of the flag, write a plus sign (+) in the square. If the two pictures 
show opposite faces of the flag, write a minus sign (—) in the square. Go right ahead. 
Do not wait for any signal. 


Form Board (21) is identical with the Minnesota Form Board test 
except for the addition of printed instructions and a fore-exercise. These 
were combined in the first page of the test. 


SAMPLES FROM FORM BOARD (42 ITEMS) 


The two black pieces can be placed together to form the outline at the right, a square. 
A pencil line has been drawn to show how the two pieces can be placed so as to fit 
exactly on the square. A horizontal line through the center of the square would also 
be a correct answer. 
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_ The three black pieces can be placed so as to make the rectangular outline. Pencil 
lines have been drawn to show one possible arrangement of the black pieces. 


In the following practice problems the first one has already been marked for you. 
Now draw pencil lines in the white outlines to show how the black pieces can be 
placed so as to fit the outlines. Do not waste time over extreme accuracy. Merely 
indicate by lines how the black pieces may be placed so as to cover the given outlines. 


Lozenges B (22) was designed by the author at Carnegie Institute of 
Technology in a study of visualizing. 


SAMPLES FROM LOZENGES B (78 ITEMS) 


Each pair of diagrams represents a lozenge-shaped card. If the two diagrams show 
the same side of the card, a plus sign is written in the square. If they show opposite 
sides of the card, a minus sign is written in the square. 


R) E 


3 
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Now work the following practice problems. Write plus if the diagrams show the 
same side of the card; write minus if they show the opposite sides. Go ahead. 


Surface Development (23) was prepared by the author. This is a new 
test of visualizing and space thinking. 


SAMPLES FROM SURFACE DEVELOPMENT (6 PROBLEMS) 


In this test you will be shown pictures of some simple objects that can be made 
from cardboard or sheet metal. With each picture there is also a diagram showing how 
a piece of cardboard might be cut and folded so as to make the object. The dotted 
lines show where the cardboard or metal should be folded. 

Look at the picture and the diagram below. The diagram shows a cardboard cut 
so that it might be folded into the shape of a box. Notice the side A in the picture and 
also the side A in the diagram. Notice that the edges e, d, f, h, in the picture are also 
marked in the diagram. 

In the schedule there are indicated certain parts of the diagram which correspond to 
certain parts of the picture. You are to fill in the blank spaces in the schedule. 

In the first line of the schedule we are to find the part of the picture that corresponds 
to the side B in the diagram. Look at B in the diagram and you will see that it corre- 
sponds to L in the picture. Therefore L has been written in the blank space opposite B 
in the schedule. 

In the next line of the schedule we are to find the part of the picture that corresponds 
to 1 in the diagram. Look at the edge 1 in the diagram and you will see that it corre- 
sponte ig the edge a in the picture. Therefore the letter a has been written in the 
schedule. 

Fill in the other blanks in the same manner. 
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PICTURE DIAGRAM SCHEDULE 
Partlof (/Part of 
the the 
picture] diagram 
ha. 
bee 


4 
& 
( 
‘ 
4 
' 
‘ 
( 
’ 
4 
( 
’ 


iL 
ed 


3 
Part of | Part of 
the the 
picture | diagram 
e4 
Ss 


Punched Holes (24) is an adaptation and extension of a form of test 
in current use. 


SAMPLES FROM PUNCHED HOLES (10 ITEMS) 


Figure 1 represents a square sheet of paper. It is folded on the dashed line and then 
it looks like Figure 2. A hole is punched through the folded paper as shown in Figure 2. 
Show by small circles in Figure 1, where the holes would be when the paper is unfolded. 
The small circles have been drawn for you in this example. 


Fra. 1 Fia. 2 
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Figure 3 is another sheet of paper. When it is folded along the dashed line, it looks 
like Figure 4. A hole is punched as shown in Figure 4. Show in Figure 3 where the holes 
would be when the paper is unfolded. 


ff ° 
° . 
ry ° 
° ° 
. ° 
° ° 
° e 
. ° 
. ° 
° * 
. ° 
BS ° 
° ° 
° ry 
° ° 
° ° 
a Beemer ccc ccce- cmc ssesccserccscecoest 


Fig. 3 Fig. 4 


Figure 5 is a sheet of paper which is folded along the dashed line. Then it looks like 
Figure 6. It is folded once more and then it looks like Figure 7. A hole is then punched 
through it. Show in Figure 5 where the holes will be when the paper is unfolded. The 
holes have been marked for you in this example. 


Fia. 5 Fic. 6 Fia. 7 


These diagrams represent in the same manner a sheet of paper that is folded twice. 
A hole is then punched through it. Show by small circles in the first square where the 
holes will be when the paper is unfolded. 


Pe ee eee eee ee _* 
¢ e 
. 
e . 
’ ° 
. ° 
. * 
i : 
~ ° 
. ° 
. ¢ 
° ° 
, e 
A e 
° * 
e . 
. ° 
° ° z 
. $ : 
C3 ° 
° ‘ ° 
* ’ « 
. ° 
® * 
‘ 2 
° 


e 

¢ ° . 
t ° 

Te eee acces coces Wece er Ga est aeveqcevesase vO send 


Mechanical Movements (25) is an extension of a test prepared by the 
author at Carnegie Institute of Technology. It was planned to be a 
test of kinaesthetic imagery. 


SAMPLES FROM MECHANICAL MOVEMENTS (22 PROBLEMS) 


In this test you will be shown pictures of mechanical movements. You will be asked 
questions about them. 

In each picture the part that makes the others move is called the driver. The solid 
sine circles represent axles which can turn but cannot move from where they are 
shown. 
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Now answer the questions after each of the pictures below. Go right ahead. 


1. If Bstarts moving in the direction shown, which way will A move, 
BL RTD Ef oisl sy, CAN e  ipla eae te SIR NS he RE EA a ee 
2. In which direction will A be moving when B has turned half way 
DEON MOTONUWHETC IG IS TOW (tir ca te oe sls ra vies Wael a 


A, B, and C are three beveled gears. 
1. If A is turning in the direction shown, which way is C turning, 
Le Oba) ae a BRO AGE ENC Ss pagel Mage OG NN CN ane eva Sn Wee) needa Le) 
MEO ANNIE DG CREVOTIVER CH tres eos oan cialle wes a wieeeeane ox Uae Yes No 
(Draw a ring around the correct answer.) 


The gears of this rotary oil pump fit very close to the sides and end of the case and 
against each other. 
1. If the gears turn in the direction shown, which way will the oil 
RO LOr Ged (sean ike clin ks inns. yest Aci nsor ec cl auites iar dite d 


1. Which part moves only part of the time?...................-.. 
DMV GiChepare is LOG CEIVCT (seat. cto «hue ets «pds cee Hele a oo a 
3. Can this mechanism operate when : moves in direction 1?...... Yes No 
4, Can this mechanism operate when A moves in direction 2?..... Yes No 
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5. If B moves in the direction 4, which way is A moving?......... 
6. How many times does A turn around while B is turning around 
ra) 11 2} een ne oe rete ld Can cte| yo wie SE A Ae 


S 


3. If the worm were taken off, reversed, and replaced on the same 
shaft, which way would A°tutmi: -) 3%: eine cose fe eee 


meh 


ati 


1. If the fan is turning in the direction shown, which way does it 
blow ‘the ain? iv sss sate Ac ees eee ee ee 
2. If this were a propeller on a boat, which way would the boat 
MOVER ots POETS oe a Se, eat ere eee 
8. It ie were a propeller on an airplane, which way would the plane 
MOVE! oc °s oo bic dg 5b ss ete Pe) eect erate Ska coke aay eae at ga Oren 


Identical Forms (26) was adapted from a current test with the assist- 
ance of Mr. Alfred Sterges. This test was included in the battery in 
the hope of discovering by factor analysis whether the quickness in 
perceiving details in flat form is distinct from the ability to visualize 
the movement of objects in flat space and in solid space. 


SAMPLES FROM IDENTICAL FORMS (60 ITEMS) 


The first figure in each line below is exactly the same as one of the five numbered 
figures following. In the blank space at the right of each line, write the number of the 
figure which is exactly the same as the first figure in the line. The first two blank 
spaces have been filled in correctly. You fill in the other three. Go right ahead. 
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Pursuit (27) was adapted and extended from a short test of similar 
form by Professor T. W. MacQuarrie. Several of his tests have been 
reproduced in the present battery with his permission. 


SAMPLES FROM PURSUIT (8 DIAGRAMS) 


Figure 1 consists of ten lines which run across the diagram from left to right. The 
beginning of each line is numbered. Notice that line J begins in the upper left corner 
and ends near the bottom at the right. The figure / has been written in the space where 
it ends. Line 2 ends at the bottom space on the right, and 2 is written in that space. 

Now start with line 3 on the left. Follow it across to the right and write the figure 3 
in the space at which you end. 

The figure 3 should be written in the fourth space from the top on the right side. 

Follow each of the remaining lines from its beginning at the left to the space where 
it ends at the right. Write its number in the space where it ends. 


Copying (28) was adapted from a short test of the same kind by Pro- 
fessor T. W. MacQuarrie. It involves not only visualizing a pattern in 
flat space but the score is also influenced by the subject’s motor co- 
ordination in reproducing the pattern. It is a psychological question 
whether the muscular component in a test of this sort is the same as the 
kinaesthetic imagery which is almost certainly called for in some of the 
other tests. 


SAMPLES FROM COPYING (36 DIAGRAMS) 


In this test you are to copy each of the figures in the dotted space to the right of it. 
The little circles show you where to begin. There is a dot for every corner. 


Figure A has been Copy Figure B Copy Figure C Copy Figure D 
copied asanexample in the dotted space. in the dotted space in the dotted space. 
in the dotted space Begin at the small in the same man- 
to the right of it. circle and use the ner. 

heavy dots as 
guides. 
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Copy each of the following figures in the same way. Begin at the small circles. 
Your lines do not have to be straight, but they should begin and end on dots. Make 
corrections, if you wish, but do not waste time erasing. 


Areas (29) was adapted from one of the tests of Professor Carl C. 
Brigham.’ 


SAMPLES FROM AREAS (35 DIAGRAMS) 


In each of the following figures, determine the total white area in terms of squares. 
The answers are shown in the attached circles. 


Do the same with the following figures. Give your answers in terms of squares but 
disregard the size of the squares. Use fractions. where necessary. 


Number Code (30) was designed by Thelma Gwinn Thurstone. It 
makes use of the Mayan number code. This test involves some number 
facility, and it probably calls for one or more of the visualizing factors. 
It may also be complicated by a learning factor. It was introduced in 


3 Ibid. 
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an effort to diversify the number tests. Most number tests seem to be 
limited to simple numerical calculation and to arithmetical reasoning 
problems. 


SAMPLES FROM NUMBER CODE (40) 


In this test you will be asked to use a number code based on twenty symbols instead 
of the ten digits to which we are accustomed. There is a symbol for each of the numbers 
from 0 to 19, as shown below. Notice that a bar means 5 and that a dot means 1. For 
example, the number 9 is represented by a symbol consisting of a bar and four dots. 
Zero is represented by a U-shaped symbol as shown. 


For numbers larger than nineteen, the symbols are combined, one above the other. 
This is shown in Example 2 below. When there are two symbols, one above the other, 
the upper one is to be multiplied by 20 and the bottom symbol is to be multiplied by 
1. The answer is the sum. Study Example 2. 

For numbers larger than 399, three symbols are used, one above the other. The 
uppermost symbol is multiplied by 400, the next by 20, and the bottom symbol by 1. 
The answer is the sum. Study Example 3. 


EXAMPLE 1 EXAMPLE 2 EXAMPLE 3 


eee X 400 =1200 


Now solve the six practice problems below. The first two have already been solved 
for you. 


Space for figuring Answer 


Xx! = 13 i) 


x 20=140 


Se le ©) 
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Addition (31) is a simple test of ordinary addition of seven two-digit 
numbers. 

Subtraction (32) is a simple test of subtraction involving four-digit 
numbers. 

Multiplication (33) 1s a simple test involving the multiplication of 
six-digit numbers by a single-digit number. 

Division (34) 1s a simple test involving the division of seven-digit 
numbers by a single-digit number. 

Tabular Completion (35) was designed by the author as a part of a 
clerical examination. The subject is asked to fill in the missing numeri- 
cal entries in a table by examining the column headings. It involves 
very simple reasoning and very simple calculation. 


SAMPLES FROM TABULAR COMPLETION (4 TABLES) 
In the following table there are blank spaces. Fill in the correct numbers in these 
spaces. Get the necessary information from the rest of the table. Use the space below 
each table and on the opposite page for figuring. 


MARRIAGES Divorces 
YEAR Increase Increase Neches NoaRRE 
Number P nibs? Number pacer Granted to Granted to 
receding Preceding Hosed Wit 
Year Year ns r 
1894 res 566,161 12,512 37,568 100 12,551 25,017 
L805 945 Va 598 , 855 32,694 40 ,387 2,819 |————_ 26 , 931 
1896402 Je. 613,873 15,018 42,937 |————_- 14,448 |——————— 
1807 622350) ee ae 14,765 29 , 934 


Total. .| 2,401,239 | No total 165,591 No total 55 , 220 110,371 


Estimating (36) is an extension of a test prepared by the author in 
the 1924 edition of the Psychological Examination of the American 
Council on Education. It is a numerical reasoning test in which the 
subject is asked to write his own premises. Casual inspection of this 
test frequently brings the comment that it is a test of encyclopedic in- 
formation, but this is entirely erroneous. It is a test of numerical rea- 
soning. In the original form the subject was asked to write the answer 
in a blank space. It was scored by considering the ratio of the subject’s 
answer to the correct answer. The frequency distribution of the loga- 
rithms of the answers should be Gaussian. There are striking sex dif- 
ferences in this test in that the majority of women and an appreciable 
number of men dislike the task. In the present form the test was pre- 
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pared with four alternative answers, and the subject is asked to check 
the one answer which seems to him to be most reasonable. The best 
scores are obtained by those subjects who start with some generally 
known facts as premises and who make deductions about the ex- 
pected order of magnitude of the answer. The test was scored by giving 
two points for each right answer and one point for each deviation of 
not more than one step. 


SAMPLES FROM ESTIMATING (18 ITEMS) 


This is a test of your skill in estimating facts by reasonsing. 
In the illustration below you are asked to estimate the number of children in the 
United States under five years of age. Four answers are given, one of which is correct. 


Estimate the number of children in 5,100,000 oo) 2s 
the United States in 1930 under five 11,500,000 ___ Vv 
years of age. BSrA00N000) es 
10 | 120,000, 000 115 ZOOK OOO ns Bua! 
12,000,000 


There are many ways of finding out which of the above answers is correct. For ex- 
ample, if you happen to know that there are about 120,000,000 people in the United 
States, you might estimate that the average life-span is fifty years (roughly) which 
means that (very roughly) one-tenth of the population would be under five. This 
makes about 12,000,000. Knowing that one of the above answers is correct you 
would check 11,500,000 because it is the answer nearest to your estimate. This is the 
correct answer. 

Below is another illustration. 


Estimate the population per square 8.5 
mile in the United States in 19380. Aia2 / 
suc \ser 120,000,000 _ yq 206.3 
3,000,000 3, 000, 000 1032.5 


In solving this problem, you might estimate that the size of the United States is 
(roughly) 1,000 miles by 3,000 miles. This makes a total of 3,000,000 square miles. 
Divide the population of 120,000,000 by 3,000,000. This gives about 40 persons per 
square mile. You would then check 41.3 which is the correct answer. 

Answer the sample problems given below in the same way. Do not ‘‘just guess.” 
Reason out each answer in some way, as illustrated above. You may use the extra 
space for figuring. Indicate the correct answer by a check mark. 


Estimate the number of automobiles 5,000 
registered in the United States in 1930. 26,000,000 
120 ,000 ,000 

509 ,000 , 000 

Estimate the number of paving bricks 1,000 
necessary to pave a section of street, 6,000 
20’ by 100’. 30, 000 
100 , 000 

Estimate the number of people that 123 
can be seated in a space 30° by 40’ ALS 
using ordinary folding chairs. Do not 1248 


allow for aisles. 3572 
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Number Series (37) is similar to the number-series tests in current 
use. 


SAMPLES FROM NUMBER SERIES (22 SERIES) 


The numbers in each row of this test follow one another according to some rule. 
You are to find the rule and fill in the blanks to fit the rule. 

In the example below each number can be obtained from the one before it by the 
rule add 2. The blanks have been filled in accordingly. 


2 4 6 8 10 (7) a 
Find the rule in the series below and fill in the blanks. You may use addition, sub- 
traction, multiplication, division, or any combination of these. 
10 8 11 12 13 


The above series goes by alternate steps of subtracting 2 and adding 3. You should 
have written 9 and 10 in the blanks. 

Find the rule in each series below and write the numbers in the blanks accordingly. 
There is a different rule for each line. Go right ahead. Do not wait for any signal. 


19 18 17 15 14 
8 1 14 20 
27 23 23 19 19 penne 


Numerical Judgment (38) was prepared by the author for this test 
battery. It is intended to test numerical judgment rather than speed 
and exactness of calculation. It is so arranged that the subject makes a 
judgment about the order of magnitude of the expected answer. Exact 
answers are not required. 


SAMPLES OF NUMERICAL JUDGMENT (24 ITEMS) 


In this test you are shown some arithmetical problems that have already been 
worked out. Four answers are given for each problem. One of these is always the right 
answer. You are asked merely to check the right answer. You may use the space 
on the page for figuring but do not waste time working out the exact answer. 

In the first problem below you can readily see that the first number is nearly 4 and 
the second number is nearly 7. Since 4 X 7 = 28, look for the answer that is nearest 
28. This is the third answer and it is checked. 


7.563327 
4.12395 X 6.82187 = 14.012468 ___ 
Pa ie 28. 13305 Licsais/ as) 
56. 103378 


_ In the problem below you see that the numerator is nearly 30 and the denominator 
is nearly 6. Since 30 + 6 = 5, we check the second answer which is the one nearest 5. 


29.6718 AVA2TS’ Se ed 
5.7261 — 5.1819 Vv 
6.9271 
30 
‘C7 8.4293 


Since you know that one answer is correct, there are many other tricks for finding 
out which answer that is. For example, in the problem below you see that 30 X 30 = 
900. Therefore 29 X 29 must be less than 900. You can also see that 9 X 9 = 81, so 
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that the right-hand figure of the answer will be 1. Hence 841 is the only possible 
correct answer. 


(29)? = 755. 
30 841. 
ar 865. 
901. 


In the problems below use any tricks or short cuts to find out which answer is correct 
and check that answer. Do not waste time checking exact answers because one of the 
given answers is the correct one. 

2.621 
3.01224 X 4.86537 = 6.782 
14.656 
21.387 


6.5643 

03.29736 _ 10.6327 
Be01258))s" 91.7136 
134.6973 


7698. 
13514-8271 -+- 72 -- 3'-- Sl + 9875. 
2 + lee 9 4-4 = 235) 1240) UM aly el oa kl 
8+19+22+4+64 16= UG RO pee es 


11569. 
(197)? = 23417. 
38809. 
62187. 


Arithmetical Reasoning (389) contains nineteen problems and 1s similar 
to current tests of this type. 

Reasoning (40) is a syllogism test in which the subject is asked to 
judge whether an inference follows from the given premises. This test 
was prepared with the assistance of Mr. Merrill E. Roff. 


SAMPLES FROM REASONING (33 SYLLOGISMS) 
This is a test of your ability to tell the difference between good and bad reasoning. 
The first argument below is good reasoning and is marked plus (+). The second 
argument appears similar but is bad reasoning and is marked minus (—). 
All sports are dangerous, and football is a sport. 
Therefore, football is dangerous. A ati 
Some sports are dangerous, and football is a sport. 
Therefore, football is dangerous. ba Derails 
Now mark the two arguments below in the same way. __ 
All wealthy men pay taxes. Mr. White pays taxes. 
Therefore, Mr. White is wealthy. tale 
All wealthy men pay taxes. Mr. White is wealthy. 
Therefore, Mr. White pays taxes. 
The first argument above is bad and should have been marked minus (—). The 
second should have been marked plus (+). 
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Mark the following arguments in the same way. Put a plus sign (+) for good 
reasoning and a minus sign (—) for bad reasoning. 
Knavery and folly always go together; so, knowing 
him to be a fool, I distrusted him. eat WE 
Since all metals are elements, the most rare of all 
metals must be the most rare of all elements. pel a 
None of her dresses are blue. Therefore this blue 
dress is not hers. ia 
Haste makes waste, and waste makes want. Therefore 
a man never loses by delay. pate Ee 


Verbal Analogies (41) is similar to current tests of this type. It was 
prepared with the assistance of Mrs. Dorothy Slesinger. 


SAMPLES FROM VERBAL ANALOGIES (56 ITEMS) 


Read the following row of words: 
1—foot:2—shoe 3—hand: 4—thumb 5—head 6—glove 7—finger 8—clasp _¢ _ 


The first two words, foot and shoe, are united by a certain relation, the shoe is worn 
on the foot. The next word is hand. Which of the five words following can be com- 
bined with hand in the way given by the foot-shoe relation? The answer is glove because 
the glove is worn on the hand. Therefore a 6 is written in the blank at the right. 

In the following two exercises find the word at the right which is related to the third 
word in the same way that the second word is related to the first. Write the correspond- 
ing numbers in the blanks at the right. 
1—fish:2—water 3—bird: 4—blue 5—robin 6—ocean 7—sky 8—high 
1—mayor:2—city 3—captain: 4—ship 5—private 6—general 7—store 

8—lieutenant Padi aeaees 


False Premises (42) was designed as a test of syllogistic reasoning in 
which the subject does not have the advantage of dealing with meaning- 
ful sentences. The premises are absurd and so are the conclusions. The 
subject is asked merely to judge whether the conclusions follow from 
the given premises, even though the premises are known to be either 
false or meaningless in the ordinary interpretation of the words in- 
volved. This test was prepared with the assistance of Mr. Merrill E. 
Roff. 


SAMPLES FROM FALSE PREMISES (25 SYLLOGISMS) 


This is a test of your ability to tell the difference between good and bad reasoning. 
You must judge only the reasoning in the following arguments because every statement 
is false or even absurd. 

The first argument below is good reasoning and is marked plus (+). The second 
argument appears similar but is bad reasoning and is marked minus (—). 


All haystacks are catfish. All catfish are typewriters. 


Therefore all haystacks are typewriters. estates 
All haystacks are typewriters. All catfish are type- 
writers. 


Therefore all haystacks are catfish. Lara Ss 
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Notice that the first argument below is bad reasoning, while the second is good 
reasoning. Mark them accordingly. 
Some lagoons are hilltops, and all hilltops are hungry; 
therefore all lagoons are hungry. et Pika 
All lagoons are hilltops, and all hilltops are hungry; 
therefore all lagoons are hungry. 

Mark the following practice problems in the same way. If the reasoning is good, 
mark the argument plus (+). If the reasoning is bad, mark the argument minus (—). 
Go right ahead. Do not wait for any signal. 

All pigs can fly, and all elephants are pigs; therefore all 

elephants can fly. Pct 
Some radishes are rumble-seats, and some rumble-seats 

sing soprano; therefore some radishes sing soprano. — 
No two people look just alike. Jimmie and Johnnie 

look just alike; therefore Jimmie and Johnnie are not 

two people. eee 
All street lamps have adenoids, and some street lamps 

are telephones; therefore some telephones have 

adenoids. hee a 
Since all thimbles are geraniums, the most ferocious 

thimble must be the most ferocious geranium. eth oth 
Chimpanzees are more lurid than buggies, for buggies 

are not lurid at all, and chimpanzees cannot be 

buggies. eal 
If limousines were more valuable than fleas, I should 

be the King of Spades; but I am not the King of 

Spades, therefore limousines are not more valuable 

than fleas. ane 
All violins that are made of natural gas taste bluish- 

pink. This violin does not taste bluish-pink; there- 

fore it is not made of natural gas. en 


Code Words (43) was adapted from a test of Godfrey Thomson. It 
is a type of reasoning test involving the deciphering of code. The items 
in this test were prepared with the assistance of Mr. Harold O. Gullik- 
sen. 

SAMPLES FROM CODE WORDS (21 PROBLEMS) 


This is a test of your ability to translate code words. Each symbol represents a 
letter in the English alphabet. A different code is used in each set of code words. _ 

The words written in code below mean no, to, and on, but they are not arranged in 
that order. 


WORDS CODE WORDS TRANSLATION 
no { > Srogiar a 
to ee oma 
on u hee a © 


The letter ¢ occurs only once in the words no, to, on. The symbol that occurs only 
once is [. Therefore [ must represent ¢ and the first code word is to. To has been 
written in the correct place. Since [ > is to, > is o. Then the second code word is on, 
and the third is no. 
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Reason out and answer the examples below in the same way. 


WORDS CODE WORDS _ TRANSLATION 
call OGM an Pap iectayc lo us 
miss 8 9 Y Y fear) pata ad: 
make 5 @ BA 4 Ae eee 
assent A oA AE (ae aed ANI CAG WMI NEE, pe) Pid 
allots AS Need 8 Baas Sail ste ppl ess a oa 
accent Eo. pie: Wight ae eee eee 
adduce Fw OS of a ee eae 


Pattern Analogies (44) was adapted from a similar test in the Psycho- 
logical Examination of the American Council on Education. 


SAMPLES FROM PATTERN ANALOGIES (23 ITEMS) 


! Each problem in this test consists of eight figures. The first three are called A, B, 
and C. The next five are called 1, 2, 3, 4, and 6. 

In Sample I below figure A is a large circle. Figure B is a small circle. By what 
rule is figure A changed in making figure B? The rule is ‘‘making it smaller.” Apply 
this rule to figure C which is a large square. The result is a small square. Find the 
small square in the row of five figures at the right. It is figure 2. Therefore 2 is written 
in the blank at the right. 


Sample I 
A B C 1 2 3 4 5 


@orwe: Oo a... OC OyyOueze 


In Sample II below the rule is ‘‘Figure A is turned upside down to make figure B.” 
If this rule is applied to figure C, the result is figure 4. Therefore 4 is written in the 
blank at the right. 


Sample II 


{ow T i Parr pense ine ez 


In Sample III below the rule has two parts, ‘“Make figure B larger than figure’ A 
and of the opposite color.” If this rule is applied to figure C, the result is figure 1. 
Write 7 in the blank at the right. 


Sample III 
B C 4 5 


Page ae bn tee 
© :O8 oh AE ct edy VE I a a eae 
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First, decide what rule is used to make figure B from figure A. 
Second, apply this rule to figure C and find the resulting figure among the figures 1-5. 
Third, write the number of this figure in the blank at the end of the row. 


A 


Pe%HMG>ODANDA 


B 


N 
Oo 
> 
a 
q 
1X 
-@) 


on tO: 


C 


oo Ilo MRodQntitida 


1 


-HroeAgqnt< 


2 


Ore 0 ea 


|e 


HooBfSeqggavdiple 


ojo Ll o- fX} O CO 00 > Td] & 


Syllogisms (45) was prepared by the author at Carnegie Institute of 
Technology. It was intended as a test in syllogistic form with extreme 
monotony of material. The three syllogism tests were included in or- 
der to ascertain whether the factors would be considerably affected by 
monotony or extreme variation in subject matter or by making the 


premises simple, meaningful, or absurd. 


SAMPLES FROM SYLLOGISM TEST (82 SYLLOGISMS) 


Read carefully: You will be shown a list of arguments, each followed by a conclusion. 
Some of the conclusions are right, others are wrong. 


On the line after each argument make a plus sign (+) if the conclusion is right; 
make a minus sign (—) if the conclusion is wrong. 


The three following examples are marked correctly. 


Jones is younger than Brown. 
Brown is younger than Smith. 


Therefore Smith is younger than Jones. 
Smith is older than Jones. 
Jones is older than Brown. 
Therefore Brown is younger than Smith. 


Smith is older than Jones. 


Smith is younger than Brown. 


Therefore Brown is older than Jones. 


+ 
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Answer the following practice problems in the same way. 


Brown is older than Jones. Smith is older than Jones. 
Jones is older than Smith. Smith is younger than Brown. 
Therefore Brown is older than Therefore Brown is younger than 
Smith. still bakes Jones. a anerled ah 
Smith is younger than Jones. Brown is older than Smith. 
Brown is older than Jones. Jones is younger than Smith. 
Therefore Smith is older than Therefore Jones is older than 
Brown. pees a Brown. metab ee 
Jones is younger than Brown. Brown is younger than Smith. 
Smith is younger than Jones. Brown is older than Jones. 
Therefore Smith is older than Therefore Jones is younger than 
Brown. se Smith. PLEA 


Word-Number (46) was prepared as a test involving memorizing. The 
subject memorizes a set of paired associates. Each stimulus word is 
to be associated with a response number. In the recall the subject is 
given the stimulus word, and he is asked to write the corresponding re- 
sponse number. The test is arranged with instructions and a fore- 
exercise followed by a recall. A second fore-exercise, which is longer, is 
then given. It is followed by a recall. The test proper with twenty 
words and associated numbers is then presented. This is followed by 
the recall. The test really consists of three sections with a presentation 
and recall in each section. This was done in order to make sure that the 
subjects understood the nature of the task. 

It is of interest to ascertain whether a good memory as ordinarily in- 
terpreted and the ability to memorize intentionally involve the same 
abilities. It should be possible to investigate this problem by the fac- 
torial methods. Another psychological problem is to ascertain whether 
immediate memory in memorizing test items and memory over several 
months’ or a year’s time involve the same abilities. Still another psy- 
chological question concerns the relation of attention to memory and 
memorizing and learning ability. It would be of psychological interest 
to ascertain whether the ability to memorize for immediate recall in- 
volves the same primary factors as the ability to give sustained atten- 
tion to the details of a task. The present battery was not designed to 
answer these questions, but we have included six tests under the gen- 
eral category of retentivity with varying material. Three of these tests 
are in the form of learning of paired associates. 

Initrals (47) is a paired-associates test in two sections. Each section 
is divided into two parts, namely, presentation and recall. The sub- 
ject is first given a list of names with initials. He is then asked to recall 
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the initials. Then follows the test proper with twenty-five names and 
initials which he is asked to memorize. Then comes the recall in which 
the twenty-five names are given, and the subject is asked to supply the 
initials. 

Number-Number (48) is a paired-associates test in the same form as 
the two previous tests in which the stimulus consists of a two-digit 
number, and the response is another two-digit number. This test is also 
given in two sections with two parts for each section. Together with 
the instructions the subject is given five paired numbers to associate. 
He is then asked to recall the five response numbers when the stimulus 
numbers are presented. He is given the opportunity to write the num- 
bers if he wants to learn them in that manner. Then follow the mem- 
orizing of the twenty pairs of numbers and the recall in which the twen- 
ty stimulus numbers are presented in random order. The subject is 
asked to fill in the response numbers. 

Word Recognition (49) is another test of retention. In this test the 
subject is given a set of words to examine carefully so that he will be 
able to recall which words occur in the list. In the recall he is given a 
longer list of words, and the task is to check those words which were 
presented in the first list. The test is given in two sections with two 
parts in each section. In the instructions the subject is given three 
words, and he is then shown a list of nine words in random order. He is 
asked to check the three words which occurred in the first list. He is 
then asked to study a second list of six words. In the recognition he is 
given eighteen words, and he is asked to check the six words in this 
list which were previously presented. Then follows the test proper, in 
which the subject is asked to study carefully a list of fifty words. In the 
recall he is given a list of one hundred and fifty words which includes 
the stimulus list of fifty words. The subject is asked to check the stim- 
ulus words which occur in the longer list. In preparing the final recog- 
nition list, the distractors were written by a rather definite plan. Be- 
sides the correct word there is also a synonym and a word which sounds 
like the stimulus word or which is similarly spelled. This plan for the 
distractors makes the test more difficult than if the recognition list 
were any random list of words. Fractional scoring could be used in 
order to investigate individual differences in types of errors. It is con- 
ceivable that some subjects would more frequently err by checking in- 
correct words that sound like the stimulus word and that others would 
check words that look like the stimulus word or whose meaning is simi- 
lar to the stimulus word. 
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Figure Recognition (50) was designed to parallel in form the Word 
Recognition test. This test is given in three sections with two parts for 
each section. The subject is first given several figures to examine. He 
is then given a longer list of figures and is asked to check the figures 
which occur in the first list. The subject is then given a second list of 
figures to examine. In the longer recognition list he is asked to check 
the figures previously seen. Then follows the test proper with twenty 
figures which the subject is asked to examine. The final recognition 
test has sixty figures including the twenty stimulus figures. The sub- 
ject is asked to check those which he has previously seen. 

Picture Recall (51).—This is another test involving retention in a 
form which has been used in previous studies. The subject is shown a 
picture which he is asked to examine for several minutes. After remov- 
ing the picture, he is given a list of questions concerning the details of 
the picture. 

Theme (52) is a simple test in which the subject is asked merely 
to describe a person whom he knows quite well. It was scored by Eng- 
lish instructors as a short theme. 

Hands (53) was designed by the author as a part of a battery of tests 
for the study of visualizing. The original purpose of this test was to 
involve visualizing and kinaesthesis in nongeometrical and nonmechani- 
cal form. The subject is asked to identify each of a set of pictures of 
hands as to whether it represents a right hand or a left hand. There are 
conspicuous individual differences in this test. 


SAMPLES FROM HANDS (49 ITEMS) 


In this test you will be shown a series of pictures of hands. Some of these pictures 
represent right hands, others represent left hands. Below each picture you will 
two small squares. 

If the picture represents a right hand, put a check mark in the right square; if it 
represents a left hand, put a check mark in the left square, as shown in the following 
samples, which are correctly marked. 
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: uy mark the samples below in the same way. Goright ahead. Do not wait for any 
signal. 


Rhythm (54) was designed by Thelma Gwinn Thurstone. In this test 
the subject is asked to examine sets of four lines and to check the one 
line whose rhythm is different from that of the other three. This test 
should involve some auditory and kinaesthetic factors in addition to 
possible verbal factors. It is also an attempt to introduce some material 
of auditory significance in paper-pencil form. But it is likely that audi- 
tory factors will be better isolated by tests that are more conspicuously 
auditory in character. 


SAMPLES FROM RHYTHM (26 ITEMS) 


Three of the lines below are alike in rhythm, but one is different. Notice that the 
rhythm of the third line is different from the others. Therefore a check mark has been 
placed in the blank before the third line. 


Mary, Mary, quite contrary 
Peter, Peter, pumpkin eater 

V__ Hey diddle diddle, the cat and the fiddle 
Simple Simon met a pie man 


Read the four lines below and decide which line differs in rhythm from the others. 
Place a check mark in the blank before that line. 
Consider only the rhythm. Length of line is not to be considered. 


The mountains look on Marathon 
It was night in the lonesome October 
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_____ And when she fell in feeble health, ye blessed her that she died 


We are but pebbles on this rocky shore of life 


You should have placed a check mark before the second line. 
In each exercise below three lines are alike in rhythm and one is different. Check 
the line which is different in each group. 


By the flow of the inland river. 


Yet the cards they were stacked. 


I do not own an inch of Jand. 


Then I strove to go down to the sea. 


If wishes were horses, then beggars would ride 


To market, to market, to buy a fat pig 


There was an old woman who lived in a shoe 


There were two birds sat on a stone 


Sound-grouping (55) was designed by Thelma Gwinn Thurstone as 
another attempt to introduce auditory factors in paper-pencil form. In 
this test the subject is given sets of four words, one of which sounds dif- 
ferent from the other three. 


SAMPLES FROM SOUND-GROUPING (87 ITEMS) 


In the line below, notice that the three words, comb, foam, and home, can be grouped ~ 
together because they sound somewhat alike. The word come does not ‘belong with the 
other three because it sounds different. Since come is the fourth word, 4 has been 
written in the blank at the right. 


1—comb 2—foam 3—home 4—come........ Y 


Three of the words in the line below belong together because they sound alike, while 
one of the words does not belong because it sound different. Write the number of that 
word in the blank at the right. 


1—praise 2—chase 3—maize 4—phase........ 


The word chase does not belong with the other three. You should have written 2 in 
the blank. 

In each of the lines below, think how the words would sound if you pronounced them 
aloud. Find the three words which can be grouped together because they sound alike 
in some way. Then write the number of the other word in the blank space at the right. 
Go right ahead. Do not wait for any signal. 


1—toil 2—spoil 3—spool 4—coil.......... Ox 
1—mate 2—male 3—late 4—prate........ DL 32s RIB 
1—altar 2—halter 3—pSalter 4—hbarter........ ln ae 
1—-gone 2—cone 3—groan 4—knowi athe te 


1—good 2—hood 3—mood 4—wood........ ee Ril 
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Spelling (56) is an objective true-false test of one hundred words. 

Grammar (57) is an objective test of grammar in which the subject 
is asked to correct each wrong sentence by changing a single word. 
This test was assembled by Mr. John M. Stalnaker. The test contains 
fifty sentences. 

Vocabulary (58) is an objective test of one hundred items which was 
assembled by Mr. John M. Stalnaker. It is more difficult than (60). 

Free Writing (59) is merely the total word count of the theme written 
in test 52. 

Word Knowledge (60) is the Thorndike Vocabulary Test. 

In addition to the fifty-six measures in the present battery, each of 
the two hundred and forty subjects was asked to fill in a vocational in- 
terest schedule for which a separate analysis has been made. 


CHAPTER III 
THE FACTORIAL ANALYSIS 


THE INTERCORRELATIONS 


FTER the tests had been given, they were scored according to the 
A scoring formulas that are given in Table 1-7. The multiple-factor 
analysis required first the intercorrelations of the fifty-six tests. 

This computing involved nearly sixteen hundred correlation coefficients, 
and it was decided to reduce the computational labor by using tetra- 
choric correlation coefficients instead of product-moment coefficients. 

The use of tetrachoric coefficients involves an assumption that has a 
fundamental relation to the psychological postulates on which the anal- 
ysis is based. The factorial methods assume that each test performance 
can be expressed in first approximation as a linear function of the sev- 
eral factors. If one or both of the tests whose distributions enter into a 
correlation table are skewed, then the product-moment coefficient will 
deviate from the corresponding tetrachoric coefficient for the same table 
if the dichotomies are placed at or near the medians. There is no reason 
to suppose that the particular shape of the distribution of raw scores has 
fundamental psychological significance, since its shape can be altered 
by arbitrarily introducing different proportions of items of various de- 
grees of difficulty. There was no previous standardization to introduce 
in these tests either a rectangular or any other form of distribution of 
difficulty. Consequently the distribution of raw scores may be regarded 
as essentially arbitrary. Most of the distributions are unimodal, as was 
to be expected. The simplest psychological assumption that can be 
made is that each of the primary abilities is distributed normally in the 
experimental population. If that assumption is true, then any linear 
function of the standard scores in the primary abilities will also be nor- 
mally distributed in the experimental population. Hence the distribu- 
tions of scores in the tests should be normal. 

The most complete procedure would therefore seem to be to normal- 
ize each of the distributions of raw scores and then to compute the prod- 
uct-moment coefficients. But this assumption that the given distribu- 
tions of raw scores require normalizing before entering the correlation 
tables is also just the assumption that is implied by the tetrachoric 
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coefficient. Hence, in using tetrachoric coefficients, we are estimating 
the product-moment coefficient for the normalized distributions of 
scores. In using the tetrachoric coefficient, we are sacrificing some ac- 
curacy but we are not introducing any new assumptions into the fac- 
torial analysis. If the raw scores were allowed to enter directly into the 
correlation coefficients, we should have incorrect values in case the raw 
distributions deviate from normality, since we assume that these dis- 
tributions are normal. 

The factorial analysis could be made with the explicit assumption 
that the raw distributions are of the correct form, but such an assump- 
tion would require defense in that the forms of the raw distributions 
are known to be essentially arbitrary. A situation might arise in which 
the latter procedure might be psychologically defensible. If it should 
be discovered that some of the raw distributions are bimodal, then our 
present procedure, which implies the normalizing of the distributions, 
would be incorrect. Bimodal distributions are seldom if ever found for 
psychological tests, so that the safest procedure at the present time 
seems to be one in which the underlying theoretical distributions are 
assumed to be normal. The fact that bimodal distributions are not 
found in psychological tests may be due to the complexity of the tests. 
If relatively pure measures of the primary abilities can be developed, 
it would be of psychological importance to discover truly bimodal dis- 
tributions that can be attributed to discontinuities in the fundamental 
measures of a primary ability. The factorial analysis of this case has» 
been previously discussed.’ For the present it seems best not to assume 
any discontinuities in the primary abilities and to proceed with the 
simpler and more generally acceptable case, namely, that the under- 
lying theoretical distributions of test abilities are normal even if slight 
deviations from normality are found in the arbitrary distributions of 
raw scores. This is the assumption on which the tetrachoric correlation 
coefficient is based. 

The computation of the tetrachoric coefficients was made by means 
of facilitating tables by which each coefficient can be determined in a 
few minutes.? The tetrachoric coefficients are given in Table 2 of the 
Appendix. The correlations are positive or zero with few exceptions. 
The distribution of correlation coefficients is given in Table 1. The 

1], L. Thurstone, The Vectors of Mind (University of Chicago Press, 1935), chap. viii; 
Multiple-Factor Analysis (University of Chicago Press, 1947), chap. xiv, pp. 343-44. 


2 Leone Chesire, Milton Saffir, and L. L. Thurstone, Computing Diagrams for the Tetra- 
choric Correlation Coefficient (Chicago: University of Chicago Bookstore, 1933). 
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probable error of a tetrachoric coefficient whose true value is zero is 
about .07 for a population of two hundred and forty subjects when the 
dichotomic lines are at the medians.* It is therefore to be expected 
that a few coefficients will have negative values which should not be 
lower than about —.30 on the assumption that the true values of some 
of the coefficients should be as low as zero. This is what we find in 
Table 1. The present results support the general observation that psy- 
chological tests have correlations that are positive or zero. The tests 
whose correlations are zero are usually of restricted range of content. 


Table 1 


Frequency Distribution of the Intercorrela- 
tions of the Fifty-seven Tests 


Cuass INTERVAL 


NB 
From To 
— .25 —.15 Z 
—.15 — .05 13 
—.05 .05 52 
05 .15 177 
15 .25 304 
25 .35 394 
35 .45 293 
45 55 208 
55 65 117 
65 .75 28 
75 .85 8 


The tests in common use in intelligence tests have positive intercorrela- 
tions, since their complexities involve common elements. 

The distributions of raw scores are given in Table 1 of the Appendix. 
It will be seen that most of them are unimodal and that the indications . 
of bimodality are not sufficiently clear to justify the assumption of bi- 
modal discontinuities. There is some suspicion of discontinuity in the 
visualizing tests which may later be the subject of special study. 

The reliabilities of the tests have been estimated by the tetrachoric 
correlations of odd and even items. These reliability coefficients have 
been recorded in the last column of Table 3 in the Appendix. It is to be 
expected that the reliabilities will exceed or equal the communalities, 
and this is found to be true for all tests except four, namely, Arithmeti- 
cal Reasoning (39), False Premises (42), Pattern Analogies (44), and 
Vocabulary (60). The inversion for the first two of these tests can per- 


3 Truman L. Kelley, Statistical Method (New York: Macmillan Co., 1923), p. 257, eq. 211. 
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haps be explained by the relatively small number of items, but no ex- 
planation seems evident for the other two inversions. 


THE CENTROID MATRIX 


The factorial analysis is made in two stages: (1) the factoring of the 
correlational matrix and (2) the rotation of the co-ordinate axes to the 
primary axes. It is not to be expected that the co-ordinate axes will be 
meaningful until they have been rotated to the primary axes of a sim- 
ple configuration. The present correlational matrix (Appendix, Table 2) 
was factored by the centroid method, which is probably the simplest of 
several available methods that do not raise the rank of the matrix with 
communalities in the diagonals. 

The residuals were studied after each Factor to ascertain whether 
additional factors should be extracted. If the number of factors is equal 
to the number of tests, the residuals vanish identically without adjust- 
ment in the diagonal cells,* but such a result is of no scientific interest. 
The rotation of the factorial matrix can be accomplished even if more 
factors have been extracted from the correlational matrix than can be 
given a clear interpretation. However, in order that a factor shall be 
meaningful, it seems to be essential that several different tests have 
significant projections on the factor. If several tests have only slight 
projections on an additional factor, then their magnitudes may be 
more or less comparable with the projections from chance variations, 
and the interpretation may then be obscured. The present data were 
analyzed to twelve factors. The twelfth-factor residuals were small 
enough so that their contributions to the correlation coefficients were 
ignored in the subsequent rotation. 

The residuals have been tabulated for each factor and are summarized 
in Tables 2a and 2b. There were 1,596 residuals for each factor. The 
table shows the mean and the standard deviation of the distribution of 
residuals for each factor. The algebraic sum of the residuals is identi- 
cally zero for each factor. The standard deviation was determined from 
the truncated distribution of residuals, all taken with positive sign, and 
with the point of truncation at the algebraic mean which is zero. 

The modal correlation coefficient in Table 2 of the Appendix, sum- 
marized in Table 1 of this chapter, is about .35. The probable error of a 
tetrachoric coefficient of .35 for a population of 240 and with both of 
the dichotomic lines at the medians is .062. The standard error would 
therefore be about .09. The higher coefficients have smaller probable 

4 The Vectors of Mind, chap. iii; Multiple-Factor Analysis, chap. ii, p. 82; chap. viii, p. 149; 
chap. xiii, pp. 282-87. 
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errors. It will be seen in J'ables 2a and 2b that the standard deviations 
of the residuals are much smaller than would be expected by this cal- 
culation. | 

With each successive factor it is to be expected that the dispersion of 
the residuals will be reduced. This effect can be seen by inspection of 


Fable 2a 


Frequency Distribution of Residuals 


FREQUENCIES FOR Eacu CENTROID FACTOR 
REsIDUALS, D1sRE- 
GARDING SIGN 


I II III IV Vv VI VII VIII 

000 O20 os ete 199 260 281 313 344 380 397 411 
O20 O40 anes 203 255 293 291 317 317 329 365 
040-060 oye at 187 240 242 272 276 279 283 279 
O60 O80 oaenies 191 197 227 229 216 216 224 225 
080.100 ain eee 163 166 169 164 174 163 154 125 
LOO LQ oars aenchele 153 150 139 123 109 100 86 87 
T2020 AO ais bi 115 96 88 68 64 61 50 
1406 160 nn, ete 88 72 64 44 35 37 36 29 
160 SO emer 62 43 28 33 33 28 19 17 
180) 200s. scaae 52 29 18 14 12 7 6 6 
200-220 rai) eae 50 27 17 12 8 3 0 1 
220 240 teers 41 18 7 6 2 2 1 1 
B40= 260 20. sys sheen 23 7 9 4 2 
AOU LO iors we slats 20 4 4 1 

1002 BOOTS. Ohad) 17 6 0 1 

ey UU erat team et ce 9 0 1 0 
320-. 340.20. 7 2 0 0 
340— 360.0 shoes & 2 0 0 
BO OSU en 5 5 0 1 1 
380-.400........... 6 1 
400420) 3. lens ha 0 0 
420—. 440 2 0 
AAQ— 540 ii isl Nog 3 2 1 
4604808 ee sine 1 i 

UM rua eee ayers: 1,596 | 1,596 | 1,596 | 1,596 | 1,596 | 1,596 | 1,596 | 1,596 


Mean deviation. . 0998 .O771 | .0686 | .0639 | .0590 | .0558 | .0580 | .0507 
Standard  devia- 
SOD aie .1269 | .0977 | .0859 | .0793 | .0738 | .0700 | .0667 | .0640 


Table 2. In Figure 1 the standard deviation of residuals has been plotted 
against the number of factors. The dispersion of the residuals is re- 
duced as the number of factors is increased. The break in the continu- 
ity of the curve at the tenth factor is caused by a change in the method 
of computation for the last four factors in Figure 1. The centroid meth- 
od was used with sign-changing until each column of the residual matrix 
had a majority of positive signs. At the tenth factor a refinement was 
introduced in that the sign-changing was continued until the algebraic 
sum of each column of residuals was positive or zero. This required 
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slightly more labor and a few more sign changes for each factor. How- 
ever, it improves the solution in that it increases the amount of the total 
variance of the tests that is accounted for by each new factor. Hence 
the dispersion of the residuals is depressed more rapidly than when this 
final adjustment in sign-changing is omitted. The maximum slope of 


Table 2b 


Frequency Distribution of Residuals 


FREQUENCIES FOR EacuH CENTROID FACTOR 
RESIDUALS, DISRE- 
GARDING SIGN 


IX x XI XII XIII 
OO0—, O10. ie. ee ce es 215 245 260 262 273 
O10 020 ee asics 192 227 228 250 252 
STOO fo ae een fs. 203 201 204 219 243 
OU] 1: 0 a ae 171 150 200 193 177 
O40=, 050: b.4. ees cee 163 164 176 167 181 
WM ROG heehee cce s ely Gack 148 136 114 135 112 
OG0—- 0702.00 ews 118 112 94 96 105 
O70—. ORO sos hohe wesw 85 87 105 89 92 
O80 090. ele es 69 77 79 65 50 
O90=_ 100 Fob ds ok: 70 65 40 43 47 
DOCS TIO. ans oe 45 38 30 ao 22, 
PAO OPO! es oes cok eroiaees 31 vig Dap 15 17 
2.1 2S ee 25 26 13 13 16 
eI AG ok ai tae pape 13 12 5 3 
0S Cs Da ee 10 14 10 7 0 
POGOe ass va wile 14 4 4 1 3 
AL 1 Wd 9 e 5 3 0 0 0 
BOP SOE ok bbe ccs hed 4 1 Z 2 3 
Pe 190 lahat Sars oc 4 4 2 1 
LOO 200 ek ne EN 2 it Be 0 
UE LO aie ey uesesy 1 1 
SSUUEMNe ees aes aie 1,596 1,596 1,596 1,596 1,596 
Mean deviation.... .0487 .0456 .0423 .0401 .0387 
Standard deviation. .0612 .0579 BS GS .0507 .0489 


the curve of Figure t would be obtained by determining the principal 
axes, but this would be more laborious and would necessitate an esti- 
mate of the communality of each test. 

The intercorrelations in the present study were factored first to nine 
factors. Considerable work was done on the rotation of the first nine 
columns of the centroid matrix. It was later decided to continue the 
factoring. This was done to twelve factors after which the rotations 
gave psychologically meaningful factors. FinaHy, an additional factor, 
the thirteenth, was computed, but it did not show sufficiently large 
entries in the centroid matrix to justify rotation. The centroid matrix 
to twelve factors is shown in Table 3 of the Appendix. The last two col- 
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umns of this table give the communalities and the reliabilities. This is 
the basic table for the rotational solution. It will be noted that the 
first column has all positive values and that each of the subsequent 
columns contains both positive and negative entries, as was to be ex- 
pected. 

THE NUMBER OF COMMON FACTORS 


A recurring problem in factor analysis is to determine how many fac- 
tors to extract from the correlational matrix. Several properties of the 
factorial matrix can be used as aids in making the judgment as to how 
many factors to extract. In addition to these properties, an empirical 
rule has been found to be useful. 

It is, of course, always possible to continue the process of extracting 
factors until one can ascertain by mere inspection of the residuals that 
more than enough factors have been extracted. The subsequent rota- 
tions may then reveal meaningful interpretation of several factors and 
some hints about the interpretation of minor factors which merge with 
the variable errors. This process is not very satisfactory in practice 
because of the great amount of labor in the computation of superfluous 
factors. 

One simple procedure is to compare the dispersion of the residuals 
with the probable errors of the given coefficients, but this is an uncer- 
tain criterion because the dispersion decreases only slightly for each 
factor after the first two or three factors have been extracted. This 
comparison has been shown in Table 2 and in Figure 1. 

Another interpretation of the centroid matrix is to consider the con- 
tributions that each new column makes toward the correlation coeffi- 
cients. If the two largest absolute values in a new column are, say, .20 
and .30, then the maximum contribution of the new factor is .06 to one 
of the given correlations or to one of the given residuals. If there are 
only a few such values in the new column, it seems reasonable to sup- 
pose that the factor is at least not of major significance in the system. 

A variant of this interpretation is to examine the largest positive 
and the largest negative entries in a new column of the factorial matrix. 
If these are, say, +.20 and —.30, then the thickness of the configura- 
tion does not exceed .50 in the new dimension, and this should be the 
maximum projection that can be obtained by rotation for the minor 
dimension of the system. These two methods of inspection are not defi- 
nite as criteria for the number of factors, but they aid in making a de- 
cision as to when a sufficient number of factors has been drawn from 
the correlational matrix. 
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Another method of determining the proper number of factors would 
be to consider the obtained dispersions of the residuals for two suc- 
cessive factors in relation to the dispersions that would be expected if 
the variance in the tables were all due to chance or variable errors. A 
criterion of, this type would involve, for each factor, the number of de- 
grees of freedom in the factorial matrix after determining each factor. 
A satisfactory criterion along these lines has not yet been developed. 

In order to study this problem, a set of five fictitious correlational 
matrices was prepared. The first was constructed for a fictitious set of 
twenty variables with a factorial matrix of rank one. The correspond- 
ing correlation coefficients were computed. To these theoretical coeffi- 
cients were added variable errors at random in the table but with due 
regard for the fact that the standard error of a correlation coefficient is 
a function of the coefficient itself. The variable errors were in magni- 
tude those which would be expected with a population of two hundred 
individuals. The result was a correlational matrix that was known to 
contain one significant factor and variable chance errors. 

The correlational matrix so constructed was then reduced by extract- 
ing several centroid factors. For each factor there were tabulated vari- 
ous indices that might be used to determine the number of significant 
factors. An empirical rule has been found that has been successful, so 
far, in indicating the number of significant factors. As yet there is not 
available any rational proof for this criterion. Since it seems to be suc- 
cessful, it is likely either that it is susceptible of proof or that it is an 
approximation of a rational criterion. 

The empirical rule is simply that, when all the significant factors have 
been extracted so that only chance variation remains in the residuals, 
then an empirical criterion ¢ takes a limiting value. The rule is given 
by the relation 


(1) pyaar teed 


where 7 is the number of variables in the correlational matrix, Zp, is the 
sum of the absolute values of the residuals after s factors, and Zp,4; is 
the sum of the absolute values of the residuals after (s + 1) factors. If 
the relation of equation (1) obtains, then there are s significant factors 
in the correlational matrix. The summations include the diagonal 
terms. The summation Zp, includes the adjusted diagonal terms of the 
correlation matrix just before the (s + 1)th factor is extracted. The 
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summation Yp,41 includes the diagonal elements in the residual matrix 
without adjustment in the diagonal cells after (s + 1) factors have been 
drawn. This empirical criterion was discovered by Mr. Ledyard Tucker 
in studying records of several fictitious examples that were constructed 
for this problem. 

Fortunately the criterion is independent of the standard errors of the 
given correlation coefficients. It seems to reach the limiting value when 
the residual matrix of order n X n represents a configuration that is of 
approximately equal extension in n dimensions. 

In Table 3 we have a record of the application of the empirical cri- 
terion to five sets of fictitious correlational matrices in each of which 
the number of significant factors was known. In set c of Table 3 are re- 
corded the results with a fictitious correlational matrix of twenty vari- 
ables and of rank one with variable errors. The ratio (n — 1)/n is here 
19/20 = .950. After one factor had been drawn, the criterion ¢ was 
.165, which is obviously too low. After the second factor had been 
drawn, the criterion rose to .949, which is practically identical with the 
limiting value of .950. The interpretation is then that the second factor 
for which equation (1) became satisfied was superfluous. 

In set d of Table 3 are the records for a fictitious correlational matrix 
with twenty variables, and which was constructed so as to represent 
two significant common factors plus chance errors. The chance errors 
were in each of these problems so chosen as to represent a population 
of N = 200. The sixth column shows the numerical values of the em- 
pirical criterion ¢ for each of four successive factors. The limiting value 
of ¢ for twenty random factors of equal significance is .950. After the 
first factor had been drawn, the value of @ was .593, and hence more 
factors should be tried. After the second factor had been drawn, ¢ was 
.426, and hence another factor should be tried. After the third factor 
the criterion ¢ jumped to .935, which is almost equal to the limiting 
value of .950. An additional factor gave ¢ = .964, which slightly ex- 
ceeds the limiting value. In this case the third factor was judged to be 
the first superfluous one. It may happen that the criterion .935 is sig- 
nificantly lower than .950, in which case three factors should be retained 
for rotational purposes. After completing the rotations, the third fac- 
tor would drop out as insignificant and meaningless. This situation can 
be brought about by the fact that the centroid method adds new di- 
mensions as far as possible in the common-factor space, and as far as 
possible, outside the error space. It may happen that the successive 
centroid axes are not entirely in the common-factor space and that a 
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third factor is called for in this problem in order to give rotational free- 
dom for eliminating the error space from the first two factors. 


Table 3 


Determination of the Number of Factors 


Number of Sig- Factors 
nificant Factors Extracted 


Zps Zps+1 ¢? ¢ 


a) Eight variables. Random coefficients. No common factors. 
n=8. (First set) 


CP arth recreate he 1 14.660 | 11.352 7744 . 880 | .875 
6) Eight variables. Random coefficients. No common factor. 
n=8. (Second set) 
Oe one ee ee I | 14.800 10.982 | . 7420 | . 861 | .875 
c) Twenty variables. One common factor and residual errors. 
n=20 
| Cray ae oe, 1 325.25 8.85 10272 .165 .950 
aera ene A ee 2 8.49 7.65 .9011 .949 .950 


d) Twenty variables. Two common factors and residual errors. 


n=20 
Dt yet: 1 224. 23 78.73 soll .593 .950 
Pe LER Se MP ye a ee 2 79.81 14.49 .1816 .426 . 950 
Dar ee athe 3 14.31 jp | 8742 .935 .950 
AOE COR Ltr eed Cee! 4 12.80 11.89 9289 . 964 .950 
e) Twenty variables. Four common factors and residual errors. 
n=20 
Mee SSG Ee ct tel Ce 1 145.24 98.05 .6751 . 822 .950 
7 ee Se Te Se ROTA: 2 99.2] 64.76 .6528 . 808 . 950 
¢: TU ABN cc. elt rt ay 3 66.13 47.18 . 71384 . 845 .950 
NR aha ine ee 4 47 .82 16.20 . 3388 . 982 .950 
Fa a ae OT ee 5 15773 13°32 . 8468 .920 .950 
7: SRE SPREE FA AN wt 6 13.54 le e22 .9764 .988 . 950 


In set e we have the record for a similar fictitious matrix of twenty 
variables. But this one was constructed with four common factors plus 
chance errors in the correlation coefficients. This section of Table 3 
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shows a sudden rise in the criterion ¢ at the fifth factor, which is the 
first superfluous factor. At the sixth factor the empirical criterion ex- 
ceeds the limiting value of .950. 

One correlational matrix was constructed with eight variables in 
which the coefficients were all randomly distributed in the lower half 
of the matrix. The upper half was made symmetrical with the lower 
half to simulate the symmetric correlational matrix. The notation Zp, 
in set a represents the sum of these random coefficients. After the first 
factor was drawn, the criterion ¢ was .880, which was practically equal 
to the limiting value for eight variables, namely, 7/8 = .875. The in- 
ference would therefore be made that the configuration extends equally 


Table 4 
Fourteen Tests at West Point (Brigham) 


Factors Zps Zps41 $¢? $ fe = 
| itil, Se tea 13-130 21.324 .188 434 929 
DAS oe aoe 21.468 12.643 . 589 767 929 
ie ted ene 12.674 7.797 .615 784 929 
2 SO kaa 7.864 2.953 316 613 929 
he AEE 2.947 2.585 877 937 929 


in all of its dimensions, which include the variable errors, and that 
therefore no meaningful common factor can be expected. 

A second correlational matrix of order 8 X 8 was set up in the same 
manner with coefficients which were drawn at random from a previously | 
constructed normal distribution. The two matrices differed only in 
being two random samples. In set 6 the criterion ¢ was .861 after the 
first factor was drawn, and this value approached closely to the limiting 
value of 7/8 = .875. For each of these two matrices of order 8 X 8 a 
complete set of eight factors was drawn. The criterion values hovered 
about the limiting value. In these sixteen values of ¢ the maximum was 
.908 and the minimum was .790. 

Table 4 is a record of the empirical criterion for the factorization of 
the intercorrelations of fourteen tests that were given at West Point. 
The data were supplied by Professor C. C. Brigham, of Princeton Uni- 
versity. Previous study of these intercorrelations has revealed four 
clear factors, after which the residuals practically vanish. There seems 
little doubt that four common factors are sufficient for these data. The 
limiting value of the criterion is here 13/14 = .929. The criterion for 
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the fifth factor was .937, which slightly exceeds the limiting value. The 
next previous value was .613, which is evidently too low. Hence the 
fifth factor would be judged here to be the first superfluous factor. This 
agrees with previous study of these data according to which they con- 
tain only four significant common factors. 


Table 6 
The Values of ¢ for the Experimental Data 


Zps Factor Lpa4t ¢? ¢ 
1088; 8403-0, 7 saeen 1 336.184 . 3088 506 
390. 904 0 os Gases 2 259 . 920 7714 878 
200 95GB) son Weg oe 3 230.990 . 8852 941 
231.873 4 214.667 . 9258 962 
ZLSSOOG a rele 5 198.040 .9187 959 
LOS PLS eter 6 187.112 . 9416 970 
VBL Do aks cates cxis 7 178.172 . 9481 974 
LD) COR ae wernt 8 169.872 . 9485 974 
TIO C060 encase. 9 163 . 433 . 9560 978 
TO46207 eo 10 153.309 . 9336 966 
LOA S146 wre cleras i 141.984 9211 960 
TAQ0OS8 ele a 12 134.819 . 9449 .972 
LS0n4 2852 eee bee 13 130.069 . 9604 . 980 


In Table 5 we have a record of the application of the empirical cri- 
terion to the fifty-seven tests in the present experiment. For each of 
the successive factors the value of ¢ was computed as shown. The lim- 
iting value here was 56/57 = .982. The criterion rose to this value, 
namely, .980, after thirteen factors had been drawn. This finding sup- 
ports our analysis of the first twelve factors as representative of the sig- 
nificant common-factor variance in the tests. 


CHAPTER IV 


ROTATION OF THE ORTHOGONAL 
REFERENCE FRAME 


SIMPLE CONFIGURATION 


HE centroid method was used to obtain an arbitrary orthogonal 
reference frame for the test vectors. The projections on these ar- 
bitrary axes are shown in Table 3 of the Appendix. The next prob- 

lem was to rotate this frame with regard to the configuration of fifty- 
seven test vectors in twelve dimensions so that the co-ordinate axes be- 
came meaningful 

By psychological considerations the hypothesis can be entertained 
that the primary factors act positively unless they are absent from a 
performance. If this assumption is correct, then the projections of the 
test vectors on the co-ordinate axes should be either positive or zero. 
In rotating the axes, an attempt has been made so to place them that 
the test vectors have no significant negative projections, while the axes 
have been retained in their mutually orthogonal relation. 

Consideration has also been given to the desirability of maximizing 
the number of projections that are zero or near zero. It has been found 
that the configuration of the present battery of tests is quite well de- 
fined in a positive orthogonal manifold. | 

One of the criteria that have been used in locating a unique orthog- 
onal reference frame for the fifty-seven tests is the maximizing of the 
number of entries in the factorial matrix that are zero or near zero. The 
psychological plausibility of this criterion can be seen by considering 
the interpretation of the factors. Let us suppose that there exist dis- 
tinct factors, mental faculties or powers, such as facility with numbers, 
facility with words, inductive resourcefulness, ability to think in visual 
terms, quickness of perception of detail, and retentiveness. Let there 
be a list of eight or ten such faculties or possibly fifty or sixty of them. 

Now consider a matrix of order n X r which represents the normal 
or average factorial composition of n tasks and r factors. Each row of 
such a factorial matrix then represents one of the tasks. List at random 
such tasks. It is almost certain that no one of the tasks will involve all 
the abilities or faculties. In fact, it would be difficult, if not impossible, 
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to invent a unified task or problem or test question which required the 
exercise of all the factors just enumerated. The best way to convince 
one’s self about the psychological plausibility of this assumption is to 
attempt the assembly of a list of tests so designed that each one of them 
demands the exercise of each of the enumerated mental powers. It is 
almost certain that any collection of tests that we can assemble will 
have a factorial description with a very large number of vanishing en- 
tries. For example, a test in which the subject writes the opposites of 
given words as quickly as he can think of them is almost certain to make 
little or no demand on number facility or the perception of detail. A 
numerical task is likely to make a negligible demand on word fluency 
or memory. It is by these psychological considerations that we have 
confidence in being able to find, by rotation of the axes, such a reference 
frame that a unique set of vanishing entries appears in the factorial 
matrix. 

Situations can be found in which no unique solution is attainable. 
Such a case is that in which a small number of tests are of such complex- 
ity that no unique configuration exists. Such a case is also that in which 
some of the minor common factors are present in the tests to so small an 
extent that their variances are comparable with the chance-error vari- 
ance. Then a unique rotational solution is obscured by the errors. The 
usual case which is illustrated by the present study is that some of the 
factors are determinable. The remaining ones are obscured by being of 
minor significance in the experimental tests and by being comparable 
in variance to the chance errors. 

In the present problem it was encouraging to find that, when the ro- 
tations had been effected which maximized the number of nearly van- 
ishing entries in the factorial matrix, all the significantly negative en- 
tries disappeared. The result was a factorial matrix, shown in Table 4 
of the Appendix, in which the entries are positive or zero and in which 
no significant negative entries appear. This finding gives added confi- 
dence to the psychological interpretation of the factors even though we 
realize that the factorial analysis is based on the underlying assumption 
that each test performance is, in first approximation, a linear function 
of the primary factors. 

Many different methods have been used in these successive rota- 
tions, and it would be impossible to describe them all. Nor would it 
be profitable for the reader to follow in detail the many methods that 
we have tried and improved, or discarded, in the course of our work. 
The graphical method of rotating in one plane at a time is still probably 
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the best single method. It was the first one that the writer used, and it 
is still more effective than any other method that has been found so 
far. But the graphical method is not ideal. It will, no doubt, be re- 
placed by better methods eventually. While the principle of the graphi- 
cal rotations was described several years ago! and later in The Vectors 
of Mind, there has not been published an adequate description of the 
method as applied to an actual problem. Perhaps the best way to de- 
scribe it is in its application to a short fictitious problem, where it can 
be illustrated more economically for the reader than in the present 
twelve-dimensional case. 

Some of the rotations were determined by the single hyperplane 
method which has been described elsewhere.’ It is applicable only to 
the oblique case where each hyperplane is determined separately. The 
data of this problem were first analyzed to produce a set of oblique 
primary axes, but it was found that most of them were nearly orthog- 
onal. The data were then analyzed again with graphical rotations 
which maintained the reference axes in their mutually orthogonal rela- 
tions. The resulting factorial matrix is nearly the same as that of the 
oblique methods. Unless there is good evidence to the contrary, it 1s 
probably psychologically preferable to have a set of orthogonal primary 
factors. 

GRAPHICAL METHOD OF ROTATION 


The application of this method assumes that the correlational matrix 
has been factored into a factorial matrix. In the present problem this 
was done in reducing the correlational matrix of Table 2 to the centroid 
matrix of Table 3 in the Appendix. 

Each column of the factorial matrix F is plotted against every other 
column. If there are r columns in F, there will be 3 r (r — 1) diagrams. 
Each of the plots is examined to determine whether an orthogonal rota- 
tion of a pair of axes can be made so as (1) to increase the number of 
nearly vanishing entries in the factorial matrix or (2) to decrease the 
number of negative projections (or their absolute magnitudes) on the 
axes. 

Let Figure 1 represent such a plot for the orthogonal axes J and ITI. 
In this figure it is apparent that a rotation of the axes through the posi- 
tive angle ¢, will place the axes at the positions J’ and IJI’ relative to 

1]. L. Thurstone, Multiple-Factor Analysis (University of Chicago Press, 1947), chap. iv, 
pp. 108-10, and chap. x. 


2 Thurstone, “The Bounding Hyperplanes of a Configuration of Traits,’ Psychometrika, 
I, No. 1 (1936), 61-68. 
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the configuration of test vectors, and that the new location of the axes 
will reduce the number and the magnitudes of the negative projections 
on J, and increase the number of nearly vanishing projections on both 
of the axes. | 


FIGuRE 1 


Let another plot be illustrated by Figure 2 which shows the projec- 
tion of the configuration on the plane JJ-V. A rotation of these axes 
through the negative angle ¢ will 
locate them at JI’ and V’. Here the 
significant negative projections on V 
are eliminated, and the number of 
nearly vanishing projections is in- 
creased for both axes. 

After each diagram has been in- 
spected, a set of rotations is selected 
which involves each axis not more 
than once. For example, if the ma- 
trix F has six columns, it is possible 
by the graphical method, in its sim- 
pler form, to combine the rotations 
of as many as three pairs of axes in 
the same orthogonal transformation. 
It may be that profitable rotations 
are found only for one pair of axes, 
or for two pairs of axes, in which case the remaining axes are left un- 
altered in the transformation. They may be moved in subsequent 
transformations. 


FIGURE 2 
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Table 1 shows the manner in which the orthogonal transformation is 
designed to represent the rotations that were determined in Figure 1 
and in Figure 2. The given factorial matrix may be denoted F,. An 
orthogonal transformation 7’ is to be found that will rotate the axes as 
determined in the diagrams. This orthogonal rotation of the axes is 
represented by the matrix equation 


(1) FoT, = Fi, 


where F; is the new factorial matrix after one rotation. The transforma- 
tion matrix 7; is shown in Table 1. 


Table 1 
Orthogonal Transformation T; 
t hg 18 IIr' Ty’ y’ VI’ 

I 
TE 
III 
IV 
V 
VI 


By Figure 1 the axes J and [JJ are to be rotated through the angle ¢y. 
The orthogonal transformation for this rotation is 


yp ITI’ 
I || cos ¢; —sin qi 
ITI |\ sin qi COS ¢1 ||, 


and this matrix is represented in JTable 1 by the four intersections of 
rows J and III and the two corresponding columns. By Figure 2 the 
axes II and V are to be rotated through the angle ¢.. The correspond- 
ing orthogonal transformation is 


NR y’ 
II || cos dg —sin de 
V || sin ¢e COS do || , 
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and this matrix is represented in Table 1 by the four intersections of 
rows JI and V and the two corresponding columns. If there is no rota- 
tion indicated in the diagram for JV and VJ, then these two axes re- 
main unaltered. This is represented in Table 1 by the identity matrix 


LV ae 
mh “ 
VI || 0 1 |e 


by which the new axes IV’ and VI’ are identical with the given axes [V 
and VI. 

The angle ¢; is taken positive in Figure 1, and the angle ¢» is negative 
in Figure 2. The sign of each numerical entry in Table 1 is shown in 
parentheses in each cell. The geometric interpretation of each column 
in that table can be illustrated by column V’. The two entries in that 
column mean that the new unit vector V’ is the vectorial sum of (-sin ¢2) 
of the unit vector JJ and (cos ¢2) of the unit vector V. The resultant 
vector V’ is also a unit vector since the transformation is orthogonal. 
The coefficients (-sin ¢2) and (cos ¢2) are both numerically positive. 
This interpretation can be seen in Figure 2, where the unit vector V’ is 
the resultant of a fraction of the vector II plus a fraction of the vec- 
tor V. 

The transformation matrix 7; of Table 1 is orthogonal as may be seen 
by inspection. The entries in each column of the transformation matrix 
T; show the direction cosines of a new unit reference vector. Applying 
this transformation, we have the new factorial matrix F, in equation 
Gaby 

The columns of the new matrix F, are plotted against each other in 
a set of $r(r — 1) diagrams with orthogonal axes. New rotations are 
determined graphically for a rotation 


(2) FiT, = F,, 


and this process is continued until after s rotations the entries in F, sat- 
isfy the criteria that have been imposed for a simple configuration or a 
positive orthogonal manifold. 

If the centroid matrix be denoted F, its successive rotated forms may 
be denoted F., where s is the number of rotations, each determined by 
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a set of diagrams. The successive orthogonal rotations may be denoted 
T, so that 


(3) Teale a i, : 


The several transformations T, may be combined into a single or- 
thogonal transformation 7, , where 


t 
(4) ee is Bae 
s= i 
for t successive rotations. Then 


(5) ED =, 


where 7’, is the orthogonal transformation which carries the centroid 
matrix F to its final rotated form F’, in which the axes may be expected 
to be meaningful if the rotational criteria can be satisfied. This trans- 


Table 2 


Orthogonal Transformation \mp for Rotating Centroid Matriz F jm 
to the Primary Factorial Matrix F jp 


S de N V M Ww I R D 10 Ui 12 

es 304 288 280 372 282) .264) .248 368 298 279 154 279 

1D hb — .339 227) — .406 477 067| .374)— .189] — .059] — .035} — .027| — .498 088 
TEE — .498}— .518 557 161 129} .085) .214 040 064 044|— . 234] — .139 
IvV.. — .434 144] — .341)] — .330 440}— .319| .349 293 161] — .071| — .009 178 
Vas — .190 616 415 136] — .152)— .347} .004 170| — .394| — .147| — .099] — .173 
VI.. — .314|— .211)— .190 424|— .458] — .206| — .047 262] — .003 000 493 268 
Te etets ose op sitn: 156 046 098 193] — .199]— .368} .201)— .353 513} — .400} — .291 279 
VI — .072|— .052 278} — .231 125] — .090/ — .680, 139 020 013) — .135 581 
IX 203] — .213|— .075 449 621) — .377| — .184|/— .135) — .242};— .181 155} — .105 
xX 070} — .069 058] — .077 038} .426 083 250} — .153|— .824 139 094 
XI — .377 301 159} — .032 183} .223)/— .091)— .589 168] — .044 519 039 
XIT 053] — .075 016}— .029;— .015; .044 425) — .318] — .593 145} — .067 569 


formation can also be regarded as the matrix of the direction cosines of 
the new reference axes in terms of the orthogonal centroid reference 
frame. This matrix is shown in Table 2, where the columns have been 
given letter designations for the factors. This is also matrix 7’, of equa- 
tion (5), but it will be referred to as the matrix A,» whose columns show 
the r direction cosines \np for each of the r factorial axes. 

When the transformation of Table 2 is applied to the centroid matrix, 
we have 


(6) F imNmp vig F ip ) 
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where 


F jm is the given centroid matrix, Table 3 of the Appendix 
Amp is the orthogonal transformation of Table 2 
Fy is the rotated factorial matrix, Table 4 of the Appendix 


The rotated matrix Fj, is the matrix in which we may hope to dis- 
cover psychologically meaningful factors. It should be borne in mind 
that there is nothing in the factorial methods to guarantee that a simple 
configuration exists in any given table of intercorrelations. The con- 
figuration may not even be uniquely determined by the correlations. 
A unique configuration may not reveal a simple structure. Even with a 
simple structure it may not be possible to identify psychologically more 
than a few of the factors. 

Inspection of Table 4 in the Appendix shows that in all but the last 
three residual columns the projections of the test vectors on the new 
orthogonal reference axes are positive or near zero and that there are 
no significant negative projections. A projection is regarded as nearly 
zero if it is in the range plus or minus .20. A projection of .20 signifies 
a contribution of 4 per cent of the total variance of a test. In this table 
of nine factors there is no negative projection longer than —.14, which 
represents less than 2 per cent of the total variance of a test. Such pro- 
jections are regarded as negligible as far as psychological interpretation 
is concerned. The last three columns are residual factors which have 
not been given any psychological interpretation. 


CHAPTER V 


INTERPRETATION OF THE FACTORS 


HE most interesting part of a factor analysis is the psychological 
interpretation of the factors. It is encouraging to discover that 
some of the primary factors that we have found in these data cor- 
respond closely to group factors that have been previously identified. 
The rotated factorial matrix is Table 4 of the Appendix. It will be 
examined by columns. The first column has thirty-six projections in 
the range of +.20, and the lowest value is —.092. A projection or factor 
loading of .20 accounts for only 4 per cent of the total variance of a test. 
We have not regarded a projection as significant in naming a factor un- 
less it is as large as .40. The naming of a factor cannot be made with 
confidence unless the projections are as large as .50 or .60 so that the 
factor accounts for a fourth or a third of the variance of a test. Confi- 
dence in naming a factor is also determined by the number of tests that 
have significant projections of .40 or higher on the factor. The thirty- 
six projections that are nearly vanishing in the first column represent 
more than half of the tests in the Eee This factor does not enter 
negatively in any of the tests. 
Considering only those tests which have projections of about .4 or 
higher, we have the following: 


(6) Verbal Classification......... Rainn (22) LOZengeseba ny es Gane 2% . 633 
(8) Figure Classification......... .393 (23) Surface Development........ .551 
(7) Block-counting).).-05. 2.02.6 FAUST ER Coe CUrsUlbeld hs Shale wea . 584 
CV SASOT acl Gal i ED E626 URL >) se OVIOPISINS Vitor ea ook .430 
CPR ZEN CCS Ane oo aos Ped ok a PAAR CDOT ANGS pd aise sonst a eee» .455 
(OPA), LEP Ie aI a .636 (55) Sound-grouping............. .412 
C7 Oye Gr DOST o8. Sea ne eo ne he oes .415 


It requires very little inspection of these tests to bring out the fact that 
their common element is visual or spatial in character. The factor has 
been denoted S. A question concerning the general character of this 
common factor might be raised for Syllogisms (45) and Sound-grouping 
(55). The essentially visual character of the syllogism test is readily 
seen by inspection. The premises are concerned about the relative ages 
of three individuals, and the simplest way to keep them in mind is to 
represent them by lines or relative elevations. This is the way most 
79 
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people solve these syllogisms, and hence facility in visualizing augments 
the score. The appearance of a visual factor in Sound-grouping is 
puzzling and calls for separate experimentation with visual and audi- 
tory material to ascertain why the factor S should appear in Sound- 
grouping. The Verbal Classification test involves many categories that 
can be readily visualized, and it is not unlikely that this type of imagery 
facilitates the task. 

An important check on the visual character of the factor S is to in- 
spect the thirty-six tests in which this factor is absent. One might ques- 
tion why Mechanical Movements (25) does not have a large saturation 
of the factor S. The explanation may be that this test calls for some 
kinaesthetic factor which is not demanded by the other tests. This 
hypothesis can be checked by separate experimentation with a com- 
bination of visual and kinaesthetic material in the same battery. 

Until further experimental evidence is available on the saturation 
of this factor in auditory and in kinaesthetic material, we seem to be 
justified in characterizing this factor as facility in spatial and visual 
imagery. It is probably the same factor that has appeared previously 
as a Spatial or visual group factor in the experiments of Kelley.! Several 
of the factors in the present study are probably the same as those which 
Kelley has listed. 

The second column of Table 4 in the Appendix has thirty-seven en- 
tries in the nearly vanishing range of +.20 with a minimum value of 
—.072. The negligible entries represent two-thirds of the entries in this 
column. The significant entries above .40 are as follows: 


(6) Verbal Classification......... .537 (41) Verbal Analogies............ 417 
(7). Words erouping bcgintt acne .573 (44) Pattern Analogies........... .435 
Clie @om pletion: 25 aia 2) iaueteae A22.. (51). Picture Recall. cea eee . 645 
(14) Disarranged Sentences....... .461 (60) Vocabulary (Thorndike)..... .412 
(26) Identical Forms). 5.0. 1425-4 .603 


In this list Identical Forms has the highest saturation of .603, which 
represents more than one-third of the variance of the test. Our prob- 
lem is to identify, if possible, the psychological trait which is common 
to these tests and which is absent from the thirty-seven tests with 
negligible saturations for this factor. A hypothesis which agrees with 
introspective study of the mental operations essential in these tests is 
that the factor is essentially perceptual in character. Strictly speaking, 
all the tests in the battery involve perception, and vision in particular. 


1T. L. Kelley, Crossroads in the Mind of Man (Stanford University, Calif.: Stanford 
University Press, 1928). 
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But we are here concerned with those traits which are responsible for 
the individual differences that are revealed in the correlation coefficients 
of the battery. The perceptual function here seems to be a facility in 
perceiving detail that is imbedded in irrelevant material. The simplest 
expression of this function would be a task in which the subject is asked 
to identify some particular detail that is buried in distracting material. 
Given the task to find a particular word in a page of print, some people 
seem to be able to locate it by a dispersed attention to the page as a 
whole, while others require systematic search through each successive 
line of print. 

Unfortunately we had no such hypothesis in mind when the test bat- 
tery was planned so that this type of factor is not conspicuous in the 
battery except in Identical Forms (26). However, the factor is not lost 
in the specific of Test 26 because it is significantly present in some of the 
other tests, though not so strongly. In Picture Recall (51) the subject 
studies a picture for a short time in order to fix in mind the detail that 
may be asked for in a recall test. The study of the picture for this pur- 
pose may be facilitated by the present perceptual trait. In Verbal 
Classification (6) and in Word-grouping (7) there is also a large per- 
ceptual element, since each contains many easy items. The score is 
therefore determined largely by the speed of perceiving superficially 
apparent relations. The same is true for Disarranged Sentences, in 
which the best subjects sense the meaning of each sentence without ex- 
plicit rearrangement of the word order. The high saturation of the fac- 
tor P in the Thorndike Vocabulary test (60) is of interest when com- 
pared with the low saturation of the same factor in the Vocabulary 
Test (58). The explanation is probably in the great difference in diffi- 
culty of these two tests. The Thorndike Vocabulary test was easy for 
the subjects in this experiment. Hence their scores were in part due 
to speed of reading, which may be largely a perceptual factor. 

A new set of ten tests has been devised for an experimental study of 
the factor P in order to determine whether it is conspicuous in percep- 
tual tests of the type of Identical Forms when the nature of the per- 
ceptual detail is subjected to considerable variation. If our hypothesis 
is correct that the factor P involves facility in finding or in recognizing 
particular items in a perceptual field, then the saturation of this factor 
should be large in a variety of tests which have this characteristic in 
common even though they differ markedly in other respects. 

It might be suggested here that the various tests for reading readi- 
ness of young children are probably good examples of the factor P. 
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If this should be verified, it would be psychologically interesting to de- 
termine whether slow and fast readers can be differentiated by the fac- 
tor P under similar conditions of practice in reading. It will also be of 
interest to determine to what extent this factor is involved in what is 
sometimes called “‘quick intelligence” as distinguished from its more 
analytical and reflective aspects. 

The third column in T'able 4 of the Appendix represents a factor that 
is easily identified in the tests of the present battery. This column con- 
tains thirty-eight entries in the range +.20 that we consider to be 
negligible. This represents two-thirds of the tests in the entire battery. 
The tests which have saturations of .40 in this factor are as follows: 


(30)" Number Code. 0.) so. 7625 (84) Division 72. 0 ee ee .619 
(SLyt Additions) ore a eee ae .755 (85) Tabular Completion......... .392 
(82) Subtraction. ws ea eet .670 (38) Numerical Judgment........ 432 
(33), Multiplication): G05 yes .812 (89) Arithmetical Reasoning...... .383 


The common characteristic of all these tests is their numerical char- 
acter, but they do not include all the tests with numerical content, 
The exceptional case is Estimating (86), which has a projection of only 
+.020 on this factor. In that test the subject is certainly thinking about 
numerical quantities, and yet it separates sharply from the rest of the 
number tests. This fact was anticipated in discussions about the nature 
of the test. Many people dislike the estimating test. It is essentially 
logical in character, as can be seen from its factorial composition. It 
demands very little proficiency in rapid calculation. All the number 
tests in the foregoing list demand considerable facility in numerical 
calculation. The only tests in this list that are restricted to numerical 
calculation are Addition, Subtraction, Multiplication, and Division. 
The others all require other factors as well. The tests of Tabular Com- 
pletion, Numerical Judgment, and Arithmetical Reasoning all require 
verbal and logical factors in addition to the numerical, and hence their 
variances are divided among more factors than the four simple tests of 
rapid calculation. 

Since this factor is so clearly limited to the numerical tests, we can 
name it with some confidence as far as the present battery of tests is 
concerned. It has been denoted N. This factor has appeared in many 
previous studies of the mental abilities. It has appeared as a disturber 
of Spearman’s tetrad difference criterion for a single factor. It has been 
treated as a group factor by several investigators, and it was isolated 
as a separate factor by Kelley. There can be little doubt that this fac- 


INTERPRETATION OF THE FACTORS 83 


tor is the same as the one which has been previously identified as nu- 
merical in character. 

The insistence of the numerical factor makes it almost certain that 
it represents a unique ability, but one is puzzled about its psychological 
or genetic character in view of the fact that calculation is more naturally 
thought of as a cultural rather than as a biological category. There 
seems to be some evidence for the genetic interpretation of number facil- 
ity as an inherited trait. Occasionally this ability is found to be ex- 
tremely conspicuous even at an early age, and it seems then to be more 
or less independent of other abilities. Some number freaks are well en- 
dowed in other abilities, but some of them are otherwise mediocre. 
The fact that occasional feeble-minded individuals possess some degree 
of number ability indicates further that it constitutes a more or less 
independent mental ability. Of interest for this problem is the frequent 
occurrence of considerable mental ability in the verbal factors combined 
with what seems to be a blind spot for numerical and logical relations. 
Literary people are not infrequently of this type. In studying this prob- 
lem, we should keep in mind the possibility that ‘“‘number’’ as such may 
not adequately describe this factor psychologically or genetically, that 
the factor N may be more basic and general than number, and that the 
number tests constitute good examples of it. This is a possibility for 
all the factors. The question of whether they extend to broader cate- 
gories than those which are indicated in the test batteries in which they 
are discovered can be answered only by discovering further tests of 
wider range in which the same factor is unmistakably present. Thus, 
if we should find some nonnumerical tests with high saturation of the 
factor N, then it would be necessary to extend our comprehension of 
the factor to a category broader than “‘number’’ but which would in- 
clude numerical tasks. 

It has been customary to group psychological tests in three large 
categories, namely, verbal, numerical, and spatial. The spatial tests 
are here included in what we have called the factor S. The tests of sim- 
ple numerical calculation are represented by the factor N. The verbal 
tests divide themselves in our factorial matrix into two factors. These 
are the factors V and W whose differentiation is of considerable psy- 
chological interest. 

In the column V we find thirty tests with projections in the range 
+ .20 that we call negligible. This is over half of the tests in the present 
battery. The strongest negative projection is —.065, which shows that 
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the hyperplane is essentially positive.? The tests with projections great- 
er than .40 on this reference axis are as follows: 


(4) Reading I (proverbs)........ “502. (41) ‘Verbal Analogies;... = os. 3 .597 

(5) Reading II (quotations)..... “506° (42) halsetPremiisesty 4 oe ae ae 424 

(7) -Word-grouping s. i{)..<. 4.0.) 74569 455) Sound-srouping ei ieee .453 

(9) Controlled Association....... eA5O 0 (BF) Gren a cee alle pe hee dal .498 
(10) Inventive Opposites......... .635 (58) Vocabulary (Chicago)........ .395 
(16) Inventive Synonyms......... .495 (60) Vocabulary (Thorndike)..... .385 
(40) “ReaSONING elie ne wees 420 


The tests in this list are evidently logical in character. In all these tests 
the subject must deal with ideas, and the factor is evidently charac- 
terized primarily by its reference to ideas and the meanings of words. 
It can be called ‘‘verbal relations,’ with the reservation that still an- 
other verbal factor involves verbal material in a psychologically differ- 
ent manner. 

The factor W has thirty-nine test projections that are in the range of 
+.20 and with a minimum projection of —.134. This hyperplane is 
also essentially positive, and more than half of the tests do not demand 
this factor. Listing the tests with significant projections on this axis, 
we have: 


(12) Disarranged Words.......... O12 (SQ) uSpellinig: sees psy eee 508 
(13): First‘and Last. Letters... «...4 388.) ($7) sGrammarn 2) ee .530 
(U5 ADS FTANTS oo cc toccet eee .5384 (60) Vocabulary (Thorndike)..... .413 


In studying these two lists of verbal tests, it becomes apparent that 
the second list is concerned with tests in which the subject deals with 
single and isolated words. This is true without exception in the second 
list. The test with highest saturation in the factor W is Anagrams 
(15). In this test the subject is asked merely to make words that are 
composed of certain restricted letters. Nothing is asked about the 
meanings of these words. The First and Last Letter demands the as- 
sociation of a word which has the given initial and terminal letters. In 
Disarranged Words the letters of a word are given in pied order, and 
the subject is asked to write the word as it would be spelled when the 
letters are written in correct order. The tests Spelling and Grammar 
were both in the form in which single words were to be found correct or 
incorrect. The grammar test specified that, if a sentence was wrong, 
it could be corrected by changing one, and only one, word. That word 
was to be marked. 


2L. L. Thurstone, The Vectors of Mind (University of Chicago Press, 1935), chap. vi, 
p. 166; Multiple-Factor Analysis (University of Chicago Press, 1947), chap. ix, p. 189, and 
chap. xiv, pp. 341-43. 
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In the interpretation of the factor W we seem to have been fortunate 
in the inclusion of so many word tests in a variety of forms. With a 
shorter list of verbal tests it might happen that the two verbal factors 
would not be so clearly separated as they seem to be in the present bat- 
tery. The factor W seems to have as its principal characteristic a flu- 
ency in dealing with words. This factor seems to be separate from the 
verbal factor V, which is concerned with ideas and meanings. It is to 
be expected that some of the verbal tests have appreciable saturation 
in both factors such as the opposites in which the subject deals with 
words and also with ideas. The factor W does not extend to other forms 
of fluency because in that case it would have been found in some of the 
nonverbal speed tests in which the W factor is conspicuously absent. 

The factor V should be investigated with further experimental study 
of tests that involve the manipulation of ideas in verbal and in essen- 
tially nonverbal form. It is quite likely, as far as one can judge from 
the present data, that the factor V will be identified largely in terms of 
the verbal manipulation of ideas as they occur in sustained verbal dis- 
course. 

The factor M is represented by one of the columns in the factorial 
matrix with thirty-seven projections in the range + .20 and with a mini- 
mum value of —.080. The tests with significant projections on this 
factor are as follows: 


(46) Word-Number.............. .529 (49) Word Recognition........... .381 
MAN GIUIAIS cece see ne te .487 (50) Figure Recognition.......... .420 
(48) Number-Number........... .664 


All these tests were designed as memory tests. The first three tests in 
this list were in the paired-associates form, and the others were in the 
recognition form. The paired-associates recall form has the larger sat- 
uration of the memory factor. There seems to be no doubt that this 
factor is concerned with memory, and it has been denoted M. 

The problems of memory are especially interesting for the experimen- 
tal opportunities that they offer in relation to factorial methods. The 
memory factor was listed as a separate factor by Kelley, and it has ap- 
peared as a group factor in many experimental studies. It is clear also 
in the present study. Because of its significance for education and be- 
cause of its theoretical importance in psychology, it should be exhaus- 
tively studied. A few of the problems in this field may be mentioned 
here with reference to the possible use of factorial methods in their solu- 
tion. 
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One of the problems in memory is the possible differentiation between 
incidental memory and memorizing. Another problem in memory is to 
ascertain whether and to what extent the memory function is differen- 
tiated for the several modalities. There are at least two possibilities. 
There may be a separate memory factor for each modality. There may 
be a general memory factor and a separate imagery factor for each 
modality. The person who remembers faces but not names may have 
good memory but poor verbal fluency. Another individual with equally 
good memory may be deficient in visual imagery. For him it should be 
easier to remember names than faces. These and similar questions 
could be answered by the factorial analysis of appropriate tests. 

The question whether there is a factorial distinction between rote 
memory and memory for ideas can be answered in a similar way. Here 
it is essential again that the experimental battery be sufficiently broad 
so as to represent verbal and logical factors which may be responsible 
for the differentiation. The memory tests should be sufficiently diver- 
sified so that several memory factors have the opportunity to reveal 
themselves. Another memory problem is to determine to what extent 
inductive ingenuity is involved in memorizing. This relation can be 
experimentally ascertained by arranging some memory tests with the 
inductive aids already added to the material and other tests in which 
these aids are absent. The problem is related to the possible distinction 
between rote memory and what is sometimes called “logical memory.” 
“Logical memory”’ is a misnomer because it refers to memory of ideas 
which can be reproduced in paraphrased form as distinguished from 
verbatim reproduction. The factorial methods should lend themselves 
well to the solution of these psychological problems. 

One of the most interesting factors is that which has been denoted J. 
There were thirty-six tests, more than half of the battery, with small 
projections in the range +.20, and the minimum projection was —.110. 
The tests with significant saturations in this factor were as follows: 


(8) Figure Classification......... 405 (87) Number Series...) 1. wae .503 
(20) #AP eas. hie Aeane ti Cane ore .477 (44) Pattern Analogies........... 892 
(35) Tabular Completion......... .479 


The characteristic that these tests have in common is that they all de- 
mand the subject to find a rule or principle for each item in the test. 
This is conspicuous in several of the tests such as the well-known Num- 
ber Series test. Here the subject makes his responses merely to show 
that he has discovered the rule for each item. The same is true in 
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Spearman’s Figure Classification. The Pattern Analogies is also in this 
class in that the analogies are not obvious. The subject usually tries 
several hypotheses before hitting upon the correct rule. A simple test 
of analogies would be visual and perceptual in its principal factors. 
In Tabular Completion we have the same element in that the missing 
entries of the table can be filled in after the subject has discovered the 
principle by which the table was drawn. 

Verbal Classification (6) was designed to be a verbal parallel to Spear- 
man’s Figure Classification (8). The Verbal Classification test has a 
projection of .306 in the inductive factor J, but its saturation is higher 
in the perceptual factor P. This relation and several other similar cases 
illustrate the principle that the factorial constitution of a test may be 
materially altered by merely changing its difficulty and without chang- 
ing the content or the form. Another way in which the factorial com- 
ponents of a test may be altered is to give the same test at different 
age levels. A very common example is the case of a simple arithmetical 
problem, say, 3 X 14. To answer a score of such items quickly at the 
age of fifteen is indicative of the factor NV, but a four-year-old who solves 
such items rationally may reveal logical faculties, perhaps inductive, 
rather than superiority in the factor N. This is an example of what 
might be taking place. Verbal Classifications may be a test of logical 
faculties for a young child, whereas for the educated adult it may be 
so easy as to represent little more than perceptual speed. These rela- 
tions have not been adequately recognized in recent studies of the 
changes in mental organization with age. That problem may also be 
further complicated by the possibility that the several mental abilities 
may have entirely different growth functions. For example, the per- 
ceptual factor may mature much earlier than the verbal or inductive 
factors. These considerations make it advisable to isolate the mental 
abilities separately at each age level and to move with caution in ex- 
trapolating the factorial interpretation of a test for widely different 
ages. 

If it should be established that the intercorrelations of psychological 
tests tend to decrease with age, the effect can be interpreted in terms 
of a rather simple hypothesis. If we assume that the mental abilities 
of the young child are not clearly differentiated, he will use a wider 
spread of abilities in solving a problem than later when he can restrict 
his efforts to those mental abilities that are most appropriate for the 
problem. This effect is readily seen in the muscular co-ordination of 
children in which larger muscle groups are involved than when the same 
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co-ordination is effected by an older child or by an adult. Examples are 
early efforts in writing, at the piano, and in typewriting. If the mental 
abilities become more and more differentiated with exercise and matur- 
ity, it should follow that psychological tests become less and less cor- 
related with age. 

There remain two factors whose interpretation is tentative and not 
so clear as the first seven factors in Table 4. The last four columns have 
been regarded as residual factors, and they have not been rotated into 
a simple configuration. The two factors that are only tentatively identi- 
fied have been denoted FR and D. The column R has twenty-eight en- 
tries in the range +.20 with a minimum of —.101. The factor R, there- 
fore, enters positively only into the test performances. The tests which 
have significant projections on this factor are as follows: 


(THY Gonrpletion seer ee 48) °(56) ‘Spelling? O07 eae ee .410 
(25) Mechanical Movements...... .414 (58) Vocabulary (Chicago)....... 457 
(38) Numerical Judgment........ .534 (60) Vocabulary (Thorndike)..... .545 
(39) Arithmetical Reasoning...... . 583 


The characteristic that is common to these tests, and to a lesser degree 
in the tests with projections between .30 and .40, is not easy to deter- 
mine. The conventional categories of verbal, numerical, and spatial 
are clearly not applicable here. A close study of all these tests, together 
with the twenty-eight tests in which this factor is absent, has enabled 
us to make a tentative psychological category for the tests of the pres- 
ent battery. The common characteristic seems to be the successful 
completion of a task that involves some form of restriction in the solu- 
tion. The test with strongest saturation in this factor is Arithmetical 
Reasoning. Further study of arithmetical and other restrictive tasks 
will reveal the nature of this factor. 

Column D has thirty-three entries in the range + .20 with a minimum 
value of —.097. We conclude, therefore, that the factor D enters posi- 
tively into the tests. The tests with significant projections are as fol- 
lows: 


(8) Figure Classification......... .3898 (40) Reasoning.................. .525 
(25) Mechanical Movements...... .403 (42) False Premises.............. .578 


This list of tests is not sufficiently extensive to make the identification 
with certainty. Its obvious common feature is the deductive nature 
of the four tests. In Figure Classification the subject must first find 
the rule and must then apply it to the given examples. In Mechanical 
Movements the principle is apparent in each figure, and the movement 
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must be traced in the successive parts. This factor can be investigated 
experimentally with a variety of test material in which the deductive 
feature is emphasized. The psychological identification of the factor 
can be made with confidence only in case it remains conspicuously pres- 
ent in special test batteries in which other features are varied while the 
deductive nature of the tests is retained. If the present tentative identi- 
fication of the factor D is not correct, then such a special subgroup in a 
test battery will reveal a diversity of factors instead of a single common 
factor. 

The factorial methods are still imperfect but can be developed to 
become more powerful analytical tools. Among the theoretically chal- 
lenging possibilities for their further development we might consider the 
analysis of a score matrix by pairs of columns instead of by pairs of 
rows. The latter case gives the conventional correlations or cross- 
products of test scores that are summed over individuals. The former 
case gives cross-products or correlations of individuals, summed over 
tests. The development of this case leads to the description of an indi- 
vidual as a linear combination of several reference individuals which 
may be regarded as types. This kind of factorial analysis has been dis- 
cussed by Eckart and Young? and by Stephenson.‘ It has interesting 
possibilities for the psychological analysis of traits. 

Another possibility is to transcend the restrictions of linearity in the 
fundamental assumptions of factor methods in their present form. The 
more developed a science becomes, the fewer are the linear equations 
in its theoretical structure. It is possible that the residual factors are 
due largely to the warping that is introduced by this assumption of 
linearity. Fortunately a limited range of a curved surface can be repre- 
sented by a plane as a first approximation. This approximation is im- 
plied every time that we write a Pearson correlation coefficient or a 
regression equation. The critics of the assumption of linearity in factor 
analysis should recall that the same assumption underlies most of their 
current statistical procedures. While working with this simplifying 
assumption, we can expect to find the principal landmarks or dimen- 
sions of mind. Refinement in mental measurement will eventually in- 
volve nonlinear functions and phenomena of discreteness. In our pres- 
ent position, confronting the psychological chaos of speculation about 
individual differences in ability and personality, it is more profitable to 

3 Carl Eckart and Gale Young, “The Approximation of One Matrix by Another of 
Lower Rank,’’ Psychometrika, I, No. 3 (1936), 211-18. 

4 William Stephenson, “The Foundations of Psychometry,” zbid., pp. 195-209. 
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attempt the analytical extraction of meaningful categories with objec- 
tive criteria for their uniqueness than to join the perfectionists who can 
show what we already know, namely, that our assumptions oversimplify 
the phenomena that we are trying to comprehend. Even with the im- 
perfections of the factorial methods in their present form, we can re- 
solve many psychologically interesting problems objectively. 

The identification of the factors cannot be accepted unless the factors 
make psychological sense. The interpretation of the factors in this 
study has been made with this requirement in mind. Factorial analysis 
aids in discovering the principal dimensions in the experimental ob- 
servations, and it is our further task to discover the psychological mean- 
ing of each factor. Only to the extent that we succeed in isolating mean- 
ingful categories in these studies are we advancing psychological sci- 
ence. 

In the current psychological literature there is appearing a large 
number of factorial studies. Unfortunately, most of these studies are 
not taking advantage of the technical advances that are already avail- 
able, and consequently the results are not so conclusive as they could 
be even within present limitations of the factor methods. It may be of 
some assistance to list here a few of the deficiencies in many current 
studies which could be remedied even in the present state of knowledge 
about factor analysis. 

One of the most common characteristics of factor studies is the com- 
putation of a factorial matrix and the attempt to make a psychological 
interpretation without rotating the reference frame. It does not matter 
whether the factorial matrix has been produced by the centroid method 
or by the principal axes or components. In either case the configuration 
must be rotated before the factors can be even expected to have psy- 
chological meaning. One cannot expect to find several meaningful fac- 
tors by any of the current methods of factoring a correlational matrix 
without rotation of the reference frame. 

Ideally, we should not be satisfied until the factorial description of 
a test remains invariant when it is moved from one test battery to an- 
other. If a test demands the functioning of several factors in certain 
proportions, then, surely, it does not make sense if these factorial com- 
ponents are completely altered merely by asking the same subjects to 
take additional tests next week. By so doing, we add new tests to the 
battery and we alter the principal axes and the principal components 
of the tests. These axes are determined by the battery as a whole. This 
is an absurdity. We cannot, then, make any claim that the factors are 
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unique and psychologically meaningful traits of the individual subjects. 
My own first efforts in factor analysis involved this absence of psycho- 
logical uniqueness, and I therefore discarded the principal component 
description of the tests even though the solution was mathematically 
unique within each test battery. The solution which I have found for 
this problem is to rotate the reference frame into a simple structure if 
it exists in the battery. The factorial description of each test is then 
independent of the fact that the tests are assembled in a particular 
battery. To increase the number of verbal tests or to withdraw some 
spatial tests, for example, has no effect on the reference frame for a sim- 
ple structure. This type of invariance gives the possibility of identify- 
ing the reference axes in terms of unique traits of the individual sub- 
jects. 


CHAPTER VI 
INDIVIDUAL MENTAL PROFILES 


THE REDUCED TEST BATTERY 


HE identification of separate and unique mental abilities has its 
principal interest in the possibility of describing the mental en- 
dowment of each individual in each of the abilities. This problem 
was the subject of chapter xxi in Multiple-Factor Analysis, where the 
appropriate regression equations were derived for two cases, namely, 
the prediction of primary abilities from test scores and the prediction 
of test scores from primary abilities. Both of these cases are of practi- 
cal educational significance. 

In building a battery of tests for practical use in estimating primary 
abilities, we start with the battery of fifty-seven experimental tests by 
selecting a few tests to represent each primary. In making this selec- 
tion, we have kept in mind several considerations. The experimental 
tests in the present investigation were relatively short so that the bat- 
tery would cover the range of factors in current psychological tests and 
so that each factor would be overdetermined with a large number of 
tests. Hence the reliabilities are not so high as they will be when the 
tests are lengthened for subsequent editions of practical test batteries. 
Now that several of the factors are somewhat better understood, it 
should also be expected that tests will be improved by increasing the 
saturation of the factor that each test is expected to measure and by 
decreasing the saturations of other factors that are measured by other 
tests. What we have called the ‘“‘complexity”’ of each test should be 
reduced.’ It seems likely that such improvements in psychological 
tests will mark a new line of development. Instead of improving a com- 
posite test by raising its correlation with some equally complex practical 
criterion, such as academic scholarship, the tests will be improved by 
making them relatively pure measures of the primary abilities. In gen- 
eral, this will make the tests look simpler, and in some cases the tests 
will appear to be remote from the practical activities that psychological 
tests are sometimes made to simulate. The simplification of the tests 


1L. L. Thurstone, The Vectors of Mind (University of Chicago Press, 1935), chap. vi, 
p. 155; Multiple-Factor Analysis (University of Chicago Press, 1947), chap. xiv, p. 320. 
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toward relatively pure measures of primary factors will also enable us 
to use them over a wider age range, but the factorial composition of a 
test may alter with extreme variation in the age of the subjects. 

In general, the selection of tests has been made so as to reduce com- 
plexity. A shorter battery has been selected also with the consideration 
that, if it is successful, there will be a practical demand for longer tests 
and for parallel forms. Some types of material lend themselves better 
for these purposes than others. Two tests were selected to represent 
each primary factor with the exception that one factor, N, is represent- 
ed by three short tests and one of the tentative factors, D, is represented 
by only one test in the reduced battery. The total testing time for the 
reduced battery is three hours, but this time will probably be increased 
when the separate tests are made longer and hence more reliable. 


Table 1 

SPECIFICS 

FOR 
TESTS I II | III | IV V VI | VII | VIII) IX Eh MEE UD-AG I hz L2 

20 27 
7.) =e .49 25a 302-301 13 .08) .02 .18)| .06). .11/—.06/—.10) .46]..... OOS at 
ap i ka oe 47 |— .42)/— .07/— .31/— .01)/— .13) .09 |—.11;/—.03/— .13)— .20! .09).....| .63 |.6014)...... 
Sum....| .96 |— .95)/— .37/— .61/— .14;— .05) .11 .07| .03/— .02|— .26)— .01; .46 | .63 |... ../3.0497 
Normal .| .55 |— .54/— .21/— .35/— .08/— .03] .06 .04; .02;—.01/—.15)/—.01|) .26 | .86 |} .80| .99 


The method of combining several tests into a single composite test 
for each primary factor will be illustrated with the two tests that were 
selected for measuring the space factor. These two tests were Flags (20) 
and Pursuit (27). In Table 1 these two tests are represented by their 
projections on the centroid axes as shown in Table 3 of the Appendix. 
The first two rows of this table show the centroid co-ordinates of each 
test. For each test there is added an extra column for its specific factor. 
The two specifics are assumed to be uncorrelated. In other words, it is 
here assumed that the common factors account for the correlation be- 
tween the two tests. This assumption is nearly correct, since the resid- 
ual correlations are neglected. 

In the total-factor space these two test vectors are summed as shown 
in the third row of the table, where L is the length of the vectorial sum. 
In the last row of the table are shown the projections of a unit vector co- 
linear with the vector sum. It represents a new test whose raw score is 
the sum of the standard scores in tests (20) and (27), and which has 
been reduced to standard score. A similar procedure was used for com- 
bining the other tests into a composite test for each primary factor. 
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In Table 2 are summarized the results of computation like Table 1 
for each primary factor. Each row of Table 2 shows the projection of a 
composite test C on the orthogonal centroid co-ordinate axes. The sub- 
scripts refer to primaries so that, for example, Cs is the composite test of 
(20) and (27) for the primary S. In the left column of Table 2 are shown 
the tests selected for each primary factor, including the two tentative 
factors D and R. This matrix shows the composite tests C in terms of 
the centroid axes and is denoted F’o. 

In selecting the two tests, Flags (20) and Pursuit (27), consideration 
was given to the fact that other tests involving space, such as Cubes 


Table 2 
Matrix F< of the Composite Test Vectors C in Terms of the Orthogonal Centroid Axes 


I II III IV Vv VI WOGk Ss MABOC | 1B x XI | XII he 


Cg (20, 27)....| .55 |—.54 |—.21 |—.35 |—.08 |— .03 .06 04 .02 |—.01 |—.15 |—.01 | .7963 
Cp (7, 26) ..... .65 .20 |— .38 .03 .30 |— .10 .15 .04 |— .09 |—.12 .02 |— .16 | .7804 
Cy (31, 33, 34)| .52 |— .29 .55 |— .24 .25 |—.11 .02 .15 |— .18 .09 .12 |— .05 | .8695 
Gy (10, 41) w2.4 64.81 .28 |— .07 |— .14 .16 .24 |— .07 |— .09 BLS jae 2 .02 .04 | .9040 
Cy (46, 47)...| .54 .28 .16 .21 |— .22 |— .16 |— .08 sais .25 |— .23 .15 |— .05 | .6726 
Cp (12, 15)...) .61 .22 .08 |— .14 |— .28 |— .11 j|— .20 |— .06 |—.25 |—.04 -20 |— .01 | .6848 
C7 @9, 35). ...1 1,69 |— .31 . 24 .22 |— .07 .03 |— .01 |— .18 |—.04 .O1 .O1 .16 | .7439 
Cpihl, 09) sacl) 283 .03 .04 .13 .14 .08 |— .34 |— .06 |—.01 |—.06 |— .19 |—.09 | .9014 
Cy (40). a /snic .66 .13 .14 .22 |—. 28 . 36 .17 |— .03 .03 .12 .03 |— .19 | .8106 


(18), are more complex. The two tests selected are simple and can easily 
be reproduced in parallel forms. 

The perceptual factor P is represented by Word-grouping (7) and 
Identical Forms (26). Both of these tests are quite simple and can be 
reproduced in parallel forms. Care must be taken in constructing a 
word-grouping test for young subjects because for them it is likely to 
become a test of induction unless it is made perceptually simple. 

The factor N is naturally represented by Addition (31), Multiplica- 
tion (33), and Division (34). The test Subtraction (32) was not used, 
partly because it is not needed in a short battery and partly because it 
seems to reveal stronger verbal components than the three other num- 
ber tests. 

Verbal relations in factor V is represented by the well-known Op- 
posites (10) and Verbal Analogies (41). In the experimental battery the 
Opposites test was constructed in the inventive form, where the subject 
writes his responses. The original intention was to allow verbal recall 
or fluency to operate independently of any other factor that may char- 
acterize ‘‘checking right answers” in a recognition form. It is not yet 
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known whether the simpler and more objective form can be used here, 
but this question will be investigated in the near future in a special 
study of the verbal factors. As far as possible the tests should be objec- 
tive, but in the present investigation the purpose was to identify factors 
and only secondarily to introduce convenience in scoring. There is also 
a possibility that this factor will be interpreted to be more general than 
its present verbal connotation would indicate. The factor might turn 
out to be characterized in terms of symbolic representation and meaning 
in a form that is more general than its present restriction to verbal 
thinking. This question can be answered in terms of additional experi- 
mental study by the factorial methods. 

The memory factor M is represented in the reduced battery by Word- 
Number (46) and Initials (47). The Number-Number test (48) is prob- 
ably a better test of memory, but the test is more difficult. 

Disarranged Words (12) and Anagrams (15) are used in the reduced 
battery for measuring the word factor W. 

The inductive factor J is measured by Areas (29) and Tabular Com- 
pletion (35). The Figure Classification test (8) would seem to be an ap- 
propriate test for this factor, but it has high saturation on both the 
factor J and the tentative factor D. The latter factor needs further 
experimental study. The two tests chosen are simple and can be re- 
produced readily in any number of parallel forms for future editions. 

The two tentative factors R and D are measured by Completion (11) 
and Arithmetical Reasoning (39) for R and Reasoning (40) for D. There 
were two syllogism tests with saturation on D, namely, Reasoning (40) 
and False Premises (42). The latter test is strange in appearance and 
is probably not adapted for general use without some special explana- 
tion by the examiner. 

The nine composite tests can be expressed in terms of the orthogonal 
primary axes. This can be accomplished by postmultiplying the matrix 
F¢ by the orthogonal transformation A. We have then 


(1) Rep ar Femmp ’ 


which is shown in Table 3. The last three factors, 10, 11, 12, have not 
been given psychological interpretation and are arbitrary. 


THE REGRESSION ZY ON § 


The estimate of standard scores of an individual on each primary 
ability involves the regression x,; on S;; where x,; 1s the standard score 
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of individual 7 on the primary factor p, and S;; is the standard score of 
individual 7 on test 7. The regression equation? is 


(2) Yri = > Woi8is ; 


Jj 


where y;,; is the predicted value of z,;, and 

(3) Wo; = RoR 

Writing the equation in matrix form, 

(4) Yri = RyxRRESH 

In the present case the composite tests may be denoted c and d to dis- 


Table 3 


Matrix Rep of the Composite Test Vectors C in Terms of the 
Orthogonal Primary Vectors Tp 


Axis S P N VY M Ww I R D 10 11 i2 
Cae. .697| .004) .339}) .022}—.058} .000} .062) .173] .154) .182) .301] .104 
Cp.....| .258} .690) .049) .257) .082} .042)—.002} .220) .265) .145)/—.048) .151 
Cn.....J/—.012| .007) .857] .089) .034) .198} .134] .180} .156) .097} .043) .024 
Cy.....| .159} .335) .094} .689) .155) .173} .093) .261] .058} .300) .157| .194 
CMD ES, —.054| .067} .008} .279} .595) .162) .004) .051) .273) .331)/—.056) .157 
Cw.....| .063} .126} .090; .166} .141) .615) .103) .069) .270} .366) .067) .106 
Crows .112}—.006} .300) .094) .253) .083} .552) .272) .201) .230} .241] .180 
Cr.....| .126} .257) .157| .297) .259) .190) .199) .627) .072) .384) .133) .056 
Cp.....|—.047| — .053} — 035} .420} .182} .166) .202) .356) .525) .O11) .212} .291 


tinguish them from the separate experimental tests 7 and k. We have 
then 


(5) Yri = RoycRae Sai . 

The matrix R,, and Ra are square and of the order 9, since we have 
nine primary factors and as many composite tests. The transpose of 
the matrix &,, is shown in Table 3. The matrix R,g can be obtained 


either from R,, in Table 3 or from the matrix R,,, = F, in Table 2 ex- 
cept that the diagonals of R., are unity. Then 


(6) Re Rea 


2 Derived in Multiple-Factor Analysis, chap. xxi, pp. 511-16. 
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_where D is the diagonal matrix which makes the diagonal entries of 
R.g unity. Table 4 shows the matrix R.,, and Table 5 shows the inverse 
Ra. Table 6 shows the matrix f.,, and Table 7 shows the weights W,, 


Table 4 
The Matrix Rea (Equation 6) 


Cg Cp Cn Cy Cu Cw CT CR Cp 
Choe a 1.00 31 38 .303 .05 23 41 38 20 
By els ae ae 31 1.00 17 .61 .oL 33 25 53 30 
CONTR as 38 17 1.00 .29 ard 33 48 40 24 
Cy a el 33 61 29 1.00 47 48 44 73 55 
CUA 05 3l 17 47 1.00 44 34 45 44 
(O72 A 23 33 33 48 .44 1.00 38 49 41 
Clea. 41 25 48 44 34 38 1.00 59 50 
Cpe. ue 38 5a 40 af 3 45 49 59 1.00 52 
(Sy T* aae ee 20 33 24 OO 44 41 50 oo 1.00 
Table 5 


The Inverse of the Matrix Rea Is the Matric Rog 


Cg Cp Cn Cy Cu Cw Cy Cr Cp 
SN de, 0 air 1.405|— .248)/— .280;— .138 .281}]— .040)/— .368}/— .122 . 084 
CRs Seeks es + — .248} 1.700 .094|— .765}-- .065)— .051 .221}— .373 .019 
ONE Save Sik — .280 .094) 1.433 O17 .048)— .226)— .446)— .217 .079 
Gi es ee — .138}/— .765 .017; 2.843)— .279)— .212 .131}—1.204/— .515 
CTE Re aeae .281}— .065 .048)— .279) 1.528}— .347)— .153}/— .183)— .251 
OW ries. — .040)/— .051)/— .226)— .212)— .347) 1.532)/— .0382)/— .209;/— .155 
6) Chae ee — .368 .221}— .446 .131}/— .153}— .0382) 2.003/— .726)— .508 
(Ci — .122);— .373)/— .217)/—1.204;— .183)/— .209}— .726) 2.871;/— .103 
CPA As « . 084 .019 .079)— .515)— .251;/— .155)— .508)— .103) 1.721 
Table 6 


The Projections of the Composite Test Vectors C on the Orthogonal 
Primary Vectors Constitute the Matrix Rep 


S P N V M Ww I R D 
(OCs iad ae .697 . 004 .339 .022 |—.058 . 000 . 062 .173 .154 
OP riiude ies . 258 .690 .049 .257 . 082 .042 |—.002 . 220 . 265 
(5) ih ne eet — .012 .007 .857 .089 034 . 198 . 134 . 180 . 156 
CV a essa .159 .335 . 094 . 689 .155 .173 093 .261 .058 
C9 ae — .054 .067 . 008 .279 .595 . 162 .004 .051 .273 
CA Os eros . 063 . 126 .090 . 166 .141 .615 . 103 .069 .270 
OTR a elie sh, .112 |—.006 . 300 . 094 .253 . 083 .552 .272 .201 
OR a ses . 126 .257 .157 .297 . 259 . 190 . 199 .627 072 


OVA ie oe — 047 |—.053 |—.035 | .420| .182] .166| .202| .356| .525 
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which are determined by the multiplication 


(7) W ova eat Reha 
so that 
(8) Yri = WoaSai , 


by which the standard scores x,; may be estimated. 


Table 7 
The Weights Wpa 


Cg Cp Cn Cy Cu Cw Cy CR Cp 
elie MRE yeti .82 12 | —.28 05 .00 02 | —.01 |— .09 | —.17 
Pee eae — .23 81 .00 10 | —.11 02 .O1 05 | —.31 
VY eit, hase .08 O1 .95 04 .02 | —.13 .02 |}— .14] —.20 
Vea arene —.12 | —.20 . 06 1.09 .00 } —.15 | —.19 |— .29 21 
IM os oi rareh teas —.08 | —.04 | —.08 |-— .18 .67 | —.12 .18 19 | —.09 
Wore ote —.11 | —.13 .09 |— .02 | —.10 73 | —.16 04 02 
Ly eae ewaly ays —.18 | —.03 | —.12 |— .03 | —.20 Ol .78 |— .02 00 
PR eaaretast ae —.03 | —.03 | —.01 |— .88 | —.22 | —.22 |] —.16 1.09 28 
DIS doc aed .138 .38 09 |— .52 lg 15 | —.03 |— .32 68 


THE INTERCORRELATIONS OF THE PRIMARY SCORES 


Ideally, the scores x,; and x,; on any pair of primary abilities should 
be zero, since the primary axes are orthogonal. In practice the corre- 
lations will not be exactly zero. The correlations of the predicted stand- 
ard scores can be estimated as follows. 

The moment matrix for the primaries p and q may be written 


(9) My = > von 


or, in matrix form, 
(10) | Moe = YoiYia 5 


where y;, is the transpose of y,;. Substituting (8) in (10), 


1 1 
(11) N M oq — N W paSaiSicW eq ; 
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Let 

pee y Mo 
Then 
(12) Mpg = WoakacWeg - 
By (7), 
(13) Mpg = Rye(Rae Rac) Rac Rag ; 
which can be simplified to 
(14) Moq = Ryclac Rag ; 
and by (7), 
(15) Mog = Woaltag - 


The predicted values of z,; are denoted y,;. The standard deviation 
of xp; is unity by definition, and hence the standard deviations of yp; 
will be less than unity. Let the standard deviation of y,; be o,. If we 
let ¢ = o, = oc, denote a diagonal matrix with entries o,, then o}* is 
the inverse, namely, a diagonal matrix with entries 1/a,. We have then 


(16) Ry = Cael OT ’ 


whose diagonal elements are unity. Then 


(17) Roq Soa 05 W palaqoa } 
and by (7) 
(18) Roq oe carlycln, Hagoq” 


In order to solve for R,,, it is necessary to compute the values in the 
matrix R,.R7zR.,. The diagonal values of this matrix are equal to a5. 
From these may be computed the values 1/c,, which are the entries in 
the diagonal matrix o>. By (18) the intercorrelations of the estimated 
primary scores y,; may be determined. They should agree approximate- 
ly with the correlations that may be actually computed for the scores 
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Yn and y,;. The agreement will not be exact because the common- 
factor variance of each test is usually an underestimation. This is due 
to the fact that in any practical problem the common factors of minor 
significance are ignored. | 
In Table 8 we have the estimated correlations between the standard 
scores yp; in the primary factors. It will be seen that they are low. 
The two highest coefficients, namely, .22 and .24, involve the tentative 
factor D. These intercorrelations were determined by equation (18). 


Table 8 


Predicted Correlations Rpq 


S 18 N Vv M Ww I R D 
eer el ee bs 0,0) .15 .06 | — .06 | — .18 |— .15 | — .08 .02 .05 
foe 15 (1.00); — .01 .20 | — .O1 00} — .11 .13 .00 
Nips -06)) "7.01 (1.00); — .03 | — .06 .10 dl .05 04 
Vie lea O6 .20 | — .03 (1.00) aly 11 | — .06 .09 .02 
M..:\-.18 | — .01 | — 206 wil (1.00) 04 .18 15 22 
Wesel aS .00 .10 wed .04 (1.00) .O1 .00 24 
Li oul = 408 = 314 ll | — .06 wile: .O1 (1.00) .25 .10 
y Copgeee) .02 .13 .05 09 15 .00 .25 (1.00) .07 
Dawes .05 .00 04 .02 .22 24 .10 .07 (1.00) 
mn a ee 


THE MENTAL PROFILES AND VOCATIONAL INTERESTS 


It is of psychological interest to compare the mental profiles in the 
seven factors and in the two additional tentative factors with the voca- 
tional preferences of the subjects. Each subject filled in a vocational- 
interest schedule. 

In the interpretation of the mental profiles it has been found best 
not to confine one’s attention to the absolute level of each ability on the 
scale determined by the experimental group. The best interpretation 
of the mental profile is made by considering the relations of the several 
abilities to one another and to the mean level of the individual himself. 
All the primary abilities of an individual may be above the mean for a 
particular group, but, if one or two of his abilities are much higher than 
the other abilities, his vocational preferences are likely to show some 
correspondence to his mental profile. 

A few of the individual subjects will be described here as regards the 
relation between the mental profile and the occupational preferences. 
These cases are selected from the two hundred and forty subjects to 
represent various combinations. Most of the subjects do not show 
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marked atypicalities in their mental profiles so that for them the rela- 
tion of the profile to the occupational preferences is not so clear. 

One student who rates high in both of the verbal factors V and W 
and average or below in all the others likes advertising and writing. It 
must be recalled that since this experimental group was extremely high- 
ly selected, an average score here represents a good performance in 
relation to the American college population. This student has a lower 
performance in the number factor. Another student has his own highest 
performances in the two verbal factors V and W and in the memory 
factor M. He wants advertising and selling. Another student who has 
the ambition to be a poet and writer is characterized by a conspicuously 
low score on the number factor, and his highest score is made on the 
memory factor. 

A profile with the two highest scores in verbal relations V and in the 
perceptual factor P and a conspicuously low score in the problem-solv- 
ing factor F is for a student who would like to be an actor. He is in- 
terested in entertaining as a career. Another student who has a con- 
spicuously low score in the number factor with the other factors roughly 
equal wants to be a psychiatrist, a philosopher, and a teacher. 

A profile which is highest in the deductive factor and relatively high 
in space, number, and induction is that of a student who wants to study 
engineering. Another profile is high in the problem-solving factor R. It 
is for a student who wants to be a mathematician. 

One profile which is noticeable because of the conspicuously high 
score in the visual or space factor belongs to a student who wants to be 
a chemist or radio engineer. Another similar profile, characterized by a 
high score on the space factor S, belongs to a student who wants to be 
a geologist. 

Some of the profiles are characterized by an extremely low score in 
some one factor. One such profile in which verbal relations V is con- 
spicuously low, and the space factor S somewhat higher than the rest, 
is for astudent who wants to be a scientist and a mechanical engineer. 

Another profile has the two lowest scores, relative to itself, in verbal 
relations and memory. The two highest scores on this profile are num- 
ber and the tentative problem-solving factor R. This student wants to 
be a research chemist. A student whose highest factor is memory and 
who has a conspicuously low score in the factor R wants to teach his- 
tory. Some of these relations between mental profiles and occupational 
choices are amusing in that some of them seem to be determined by a 
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conspicuously high factor, and others seem to be determined by a dis- 
like that is perhaps associated with a conspicuously low factor. One 
such profile which has a conspicuously low score in the number factor 
N, and a relatively high score in the word factor W, is for a student 
who wants to be a journalist and advertiser. Two profiles with highest 
relative scores in verbal relations V belong to students who want to 
become teachers. Another profile with highest relative score in the fac- 
tor R is for a student who wants to become a physicist and mathe- 
matician. 

Further experimental study of the psychological nature of these 
factors together with other information about the subjects such as their 
likes and dislikes, their occupational preferences, and their actual per- 
formances will eventually give us more confidence in the interpretation 
of mental profiles. 
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Table 2* 
Tetrachoric Correlations of 57 Psychological Tests for 240 Subjects 


Olio. etre) a, 6) lege, \ekimner ermee) ene 
©) pay Abia) te, fo) cm el faire 4) apts) Nal gogo 
Gha) fe: Ks: kel Meets) ee te fielnia top, fo 
CO) Che teks! aD? Dae te 
fa ay, Corre! (w) tai (oylie) (diay al “eh Cat Tools 
erat te eOacrely OMT ert) oar) eri 
1D: (Sp wate otis, RUA Ain iam ale, Mees) 
MOR OR Sete wr uertet a) 1G Boma 
Oe! ie) -saie, Ys: 1s) caleba) eMule “eh w 
PRC ene act. Chevy ORO OKs 
fo: (ayy Cai) fo.) fey wun) =) ee im) fn) ote! 
Ch Chats POMLIRCNCURTY <P Corcyer edn y \aroar 
0 eset oie. va) Wy) sohcaeey Y | auvel yap ste 
CO OmUE) Olea cic) Oar tent 
45 (as o) ou Pee Velge lente: apron oats 
eilet oifertayatiet<ef ial fe (orn Set et ‘si © 
Pe eC SIRO CR OMT HOMONC). OR gti 
fw (0) [6c (a) 16) (ol (6) (mii) Joi Kul cee ie) 06 
Bri te (a9, ol fe) fe we le 8) mine, feb se 
ot Xo, (itis) teh te fel coles' ar is" cally? for tai 7 
Shier a} Wein berke el ioige. re Wale Magia 


+34/+31 
+59/+ 66 
+957|+64 
+58] +54 
+52)+60 


6 7 
+ 54|/+49 
+63/+61 


+76 
+76 
+46/+31 
+37|+37 
+52/+ 57 
+55] +62 


+50 
+42 
+64 


+29 
+67 


8 


=a 
+15 
+46 
+31 


+10 


+05 
+15 


asi? 


+28!) 


28) + 
+28] +22 
+42|/4.57 
+13}+28 
1139 


S| ee 


+30|+11/+06/+34|—10}+ 28] +40]+26]+33 
+18] +29] +26] +44! +26] +35]+ 26] +36] +42 
00] +25}+16]}+18]+28]+27|+22 
+42|+34]+16]+35/+31|+29/+50/+39/+34 


+35} +22 


13 


+27 
+34 


14 


4.25 


+09 
+18 


+25)|+51|+47 


+06 


+295 


+13 


+61 


+48 
+61 
+40 
+42 
+50 
+45 
+40 
+46 


+26] + 22)+ 26 
+16/+30}-+ 22 


+27) +25] +22)/+37/+18 


+10}/+28] 00/432 
+25; +46|+12/+46 
+48] +38/]+37|+58 
+34|+25)+421/+46 
+59|+40]+42/+51 
— 10} —06] —16}+21 
+ 26| +28) +08]+43 
+43]+33]+20)+62 


+40) +37|+22/+ 43 
+28) +25|+4 21|+37 
+34! +31]+28)/+37 
+19) +07/+12)+28 
+18] +25] +06) +37 
+61|+51}/+48/+61 
+47|+68)/+61 

+62|+67 
+638) +62 
+61|+67 
+56/+64 
+56] + 54 
+42) +63 
+45) +43 
+45] +29 
+61 
+47 
+42 
+48 
+21 
+14 
+26 
+37 
+36 


+61/+58 
+63/+58 
+53/+74 
+33/+61 
+21/+40 
+57/+49 
+34|+70 
4+33/+55 
+58|+48 
+28]+06 
+20]+24 
5| +23] +23 
207 ae 
+20/+40 
+27|+30 
+171+33 
+23]+30 
+34|+57 


22 | 23 


+20|+ 22 
+34|+ 27 
+56|+42 
+31/+30 
+54|+42 
SOY |ARLS 
+22|+32 
+29) +32 
+31/+35 
+30/+23 
+40/+31 
+15|+22 
+18)+20 
+40|+42 
+56| +56 
+64|+54 


+57 

+62/+55 
+42/+36 
+25/+43 
+49|}+43 
+42/+50 
+42/+41 
+48/+45 
+19}+14 
+21/+16 
+22/+11 
+30}+27 
+33]+30 
+33]+11 
+41/+33 
+18]/+34 
+52/+42 


+50|+34)/+40) +42] +30] +56] + 11|+27| +46] +30]+42|+30|+33 
+60] +40) +46}+ 59] + 28] +61] +46] +46] +49] +42] +54|+40|+46 


432 
+40 
+21 


+29 


+22 
+77) +62 


+18 


+28] +19 


ea +40, 


427 


3] +42) +31|+40)/+38) + 22/4 52|+13}+29 
+50] + 53] +34] +46} +28] +54|+45}+40 
+62) +45|+37/+46|+31|+47| +37] +52 
+39 wee +43/+31]/+19]+40/+37/+51 


+10 
+03 
+04 
aim ks: 
+08 
+25 
+03 
+48 
+05 
+18 
+08 
Split 
Spill 
+07 
+28 


+29]-+16]+26 
+55]/+ 50} +56 
+49] + 28]+62 
+47/+48]+ 50 
+10} —04|+32 
+07) +03] +37 
+12]/+16/}+20 
+31}+05] +42 
+32|+15/+42 
+03)+06}+ 19 
+34| —04/+37 
+34|+59!+37 
+32)+11/+423 
+49) +37) +37 
+16] +02}+33 
+37) +21/+33 
}+35!/+12)/+42 
+10} 00}—06 
+37/+27/+46 


a) 
E08 
+20 
+15 
420 
+26 
+16 
+42 
4.31 
+36 
+18 
+29 
+05 
+04 
435 


+29/+32 
+53]+50 
+28] +43 
+64] +52 
+33]+30 
+19}+30 
+32|+27 
+33|/+18 
+23/+20 
+10}+12 
+25)/+25 
+53]+40 
+20/+30 
+42/+33 
+18/+15 
+28] +28 
+03] +29 
+10] —02 
+99) 4.91 


—— O_O 
* In this table the decimal point preceding the entries has been omitted. 
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Table 2—Continwed 


Test 24°) 25:26 | 27] 28 | 29 | 30 | 31 | 32 | 33 


34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 
EA Sa So ean +28] + 28] +25] +17]+21|+43]+19|+01/+26|—03|/+18]+40]+26]+40]+32]+34]+59|]+57]+58!+52 
3 a) RS R Maa +40] +34]}+33] +09] +35|+32)+27/+11)+25}+08)+16|+43]+31/+38]+34]+31|+66|+64|+54|+60 
Os anit a lie Be oe 4+47|+44/+71/+33]+58!+44|+45/+18]+25/+28]+40/+41|+20]+45]+311+50| +42/+64|+48]+68 
(hopes Dah pene +33] +30|+42| + 25] +40|+ 20) +43/+18)+28/+17|+15)+27/|+24/+43]+33/+37|+48]+64/+43]458 
ae re oe +51/+40|+22|+40]+53/+31|+40}+19|+10}+10|}+12/+37|—03]+52]+16|+30| +28] +46/+43]+53 
AR Si + 05|+21}+15]+09| +12|+05|+07|+06]+18]+17|+06|+ 11] +06] + 10] +09] + 16] +21/+40] +22/418 
Rane ae! Paciet sb. 4+ 23]+32|+ 22)413]+35]+30]+42/+10/+40]}+18|+29]+30]+30]+37|+20]+42|+43|+60| +43] +46 
Rey et: Se +33]+47)]+46] +22) +38] +30|+30]—06|+07/+15/+26/+30]+30]+18]+35|+42|+50|+60/+42/+50 
7a a Sia +37/4+37|+25|+06]+31/+34|+30]+12]+28}+35|+25/+ 29] +11/+29]+22|+34|/+34|+40/4+31/+53 
A ie RC Rte SN te +33|+40|+12|+25| +15) +18) +25) +31] +28] +22/+25|+27/+06|+26| 00] +16] +40|+46|+40|+34 
iC acelin AS a ae +15]+18]+40]+37| +40} 4+ 28] + 40] + 21|+37/+32|+ 28] +25) +34]+44]4+25/+35]+42/+59]/4+38]+46 
PO Sree elo +15}+18]+10|+25]+22)+19)+28)+16|+ 25] + 26| + 16] + 22/— 10] + 26|+16]+31|+30|+28]+22]+28 
ha ee na 4+20|+34]+37| 00]/+24)+18]+46]+12]+25)+22/+30/+37|+28]+35}+18) +29] +56|+61/+52|/+54 
Tie ae halal Ut ane +50|+45| +40] +46] +45] +40] +58] +27|+12/+26]+ 22) +18] +40] + 26] +28] +50] +.11}+46/4+13/+45 
A ee ne +42|}+45|+45|+61/+47|+42/+48/4+21/+14/+26|+37|+36|+26|+36|+27|+39|+27|+46|+29]+40 
BOG we eee et +63] +43] +29] +38]+43]+35/+39/+17|+17|+15|+ 22|+36|+33|+42|+22/+34|/+46|+49]+ 29/455 
> ge IO Sera +53] +33]+21|+57|+34|+33/+58]+28]+ 20] + 23] +27|+20|+27|+17|+23]+34|+30|+42]/+16]+50 
ot eS ene +74/+61|+40|+49] +70] +55|+48)+06|+24/ + 23] + 24|+40]+30]+33]+30]+57| +42] +54|4+261+56 
Bow see Richa! 2% +62|+42|+25|+49]+42|+42/+48/+19|+4 21/4 22|/+30]+33/+33]+41/+18] +52)/+30]+40|+29]/4+53 
DS ie ie 3) +55|+36|+43]+43]/+50|+41|+45/+14|/+16|+11}+27/4+30]+11/+33]+34|+42|+33]+46|+32]/+50 
a8, had aaa ils a +61/+30| +40] +42/+52}+47|+11/+15/+21/+24/+35]+20]+48] +30] +53] +48] +49] +39|+72 
PFs, eR Soa +61 4+21)+24| +48) 4+42)/+37)4+11/+07/+04/+15]+42/+17/+30]+28]+521+511+46/4+35]/+48 
Fe Oe Sane | ae +30]+4+21 +22)+42) 00/+22] 00/+02/+03/+19/+16] 00/+16}+10/+16|+10|+37/+22/+40 
9 GA cat aT Os +40] + 24|+22 +42/+443/+40/+34|+21/+29]+40] + 22] + 20] +34] + 28] + 25] +22] +29] +16] +54 
Darel Wenmoaiee 3), | +42/4+48)+42/442 4+-49}+40]+30]+19)+26]/+28/+43]+18]+50|+30|+55|+33|+52|/+20/+49 
OME es oh +52/+42} 00/+43]/+49 +45}4+18]+19|+29|+42)+52/+30|+42]+43]+56|+39]/+43]+41|+47 
Slips, Weick ee mane ame +47|+37|+22|4+401+40|+45 +64|+57|+62)+51|+52/+36|+40/+43] +66]+40]+60|+39|+66 
Sct Cb a ae +11/4+11] 00/+34|+30!+18]+64 +62) +62|+54|+40/+06]+35] +28] +29] +21|+25/+18/+30 
ON ea aan pai +15|+07|+02|+21)+19|+19/+57|+62 +67/+53|+31/+15}+38] +37] +38] +33] +34) +22|+28 
ee Aah era eee +21|+04|+03]+29]+ 26] +29] +62] +62|+67 +62|+47|+14]+30]+52]+48]+10}+16]+11/+33 
0 ee ea +24/4+15]+19|+40]+28/+42]+51/+54/+53/+62 +56) +11|+41]+57|+62|+27|+28/+29/+48 
7. Fy ON Oe aa ae +35|}+42|+16|+22|+43/+52}+52/+40/+31/+47/+56 +13/+68]+48]+58]+45/+40/+36/+36 
BOE oe +20/+17| 00/+20/+18]+30]+36|+06}+15|/+14/4+11/+13 +23]+09] +30] +28] +40] +20] +33 
Ce er. +48/+30]+16|]+34|+50)+42/+40]+35]+38/+30/+41/+68/+23 +43] +72|+55|+54/+42/+58 
Se (es ioe ee +30] +28] +10] +28]+30| +43] +43] +28/4+37|+52/+57/+48/+09) +43 +64/+37/+16/+32|+42 
BOM me see 2 io) +53|/+52|+16|+25]+55| +56] +66) +29|+38/+48|+62|+58/+30|+72/+64 +50|+48/+46/+62 
Bie Poe ee eS +48] +51|+10|+22]+33|+39]+40]+21/+33]+10/+27|+45] +28] +55/+37|+50 +54|+78/+48 
4l................|+49}+46]+37|+29| +52) +43]/+60]+25)/+34/+16]+28]+40] +40] + 54]+ 16] +48] +54 +40/+72 
as 4 <n gn a ea +39] +35] +22|+16]+20/+41/+39]+18]+22/+11/+29|+36|+20]+42|+32] +46]+78]+40 +47 
eee 8 ek +72|+48]/+40|+34|+49/+47|+66|+30]+ 28/433] +48/+36|+33]+58]+42|+62|+48/+72|+47 
8 Pies et aie ee eee +50] +57|+34|+46]+57/+57|+47/ +16] +16] +10)+28]+26/+31|}+43] +46] +54|+49|+67|+48]+69 
OO ee Re Mees ea 455] +40] +35] +43] +51/+54|+50| +28] +29] +38) +45/+60|+27| +46] +33] +50|+42/+50/+51/+66 
Ee nen +20] +20] + 21| +02] +24] + 20] + 26/414] +12] +11/+14/+30] +04] + 24] +06] +32] +23|/+19]+32/+17 
Tema ty eee ah +33] +28]+28]+16|+21/+28]+35|+18]+21/+20|/+19]+23/+12/+30]+10] +22] +50] +31|+43/+48 
BOR ee +20] + 10]+10]+10|+39]+36|+41|+38]+07/+30|+26]+39|+04/+46]+ 40] +37|+20|+16|+37|+44 
OM A ls St 8 a +36] +30] + 16| +03] +28] +42] +30] +05] +12] +04] +09] +23] +08] +20] +18] +23] +33] +25] +38] +27 
ca Oe 429] + 23] +20] — 10] +23/+35]+17|—10|+09]+02]—01/+13/+11]+18]+15]+17|+33]+31|+23/+42 
A a eae +10]+16| +28] +12|+21/+10/+32]+16]+10]+16|/+10|+10}+19}+10] +22] +19] —07| +25] +06] +28 
lS ne 425|+19|4+25|+12/+29/+ 22]4+17/+12/+40]+29] + 28] + 22/ + 06]+34|+37|+34]+46|+43]/+48]+40 
53............... .}+33]+15]+03]+40]+33]+42/+50|+24|+22/+30/+30]+27|+19|]+17|+22]/+29/+21|/+28|+07/+37 
SAS Pte gi. : +35|+02] +06] + 29] +12}+29] +05] +05] + 24|+.04|+ 20] +32|+04|+27]+18]+ 13] +23] +34] +13]+23 
Sh ee 433]+15| +25] +46| +28) +33/+49| +22) +40] + 22|+ 40] +39) +11] +38] +28] +29] +33]+59/+41/+62 
Uk Ot oe 405}-+24]+19|+07|+18)/+11] +18] +09] +37|-+26]+30]+23] +20] +39] + 40] +46] +45] +28] +52/+24 
Vo ie 498/428] +12] +16] +31/ +32] +32] +19|+42/+26]/+43/+33/-+ 28] +39|+37]+40]+62|+46|+64|/+43 
Sat aa +30|+15]/+20] +10)+10| +09! +16; +14/+19]+12/+13/+16|—03]+18]+30|+38]+27|/+49]+24/+31 
ROMER ree tu) +08/+10/+22] 00/+10! HZ 417 4+ 26!+10)+24|+22|}+17|—06| +21] +25] +06] +07|+16]+16]+20 
COce eras eee as 3 +37|/+60|+40/+11/+46 +40/+35)+12, +12 peo: +37/+24]+31]+46| +52] +58] +62|+62/+62 
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Table 2—Continued 


Test 44 45 46 47 48 49 50 51 52 
yas rer +51} +52) +43) +43) +25) +27) +22) +07; +51 
Reine Rae esa +59) +51} +25) +53] +38) +48] +28) +12} +62 
Gira tas +60) +65) +30} +31) +32} +40) +33} +29} +51 
Ga eos ohne +59; +48) +18) +31] +10} +30} +31) +28] +45 
Stee see Reker Se +51} +52) —02} +06} +21) +19) +22) +02) +15 
Os he eens +21} +28) +28} +42; +13} +11] +08) +16) +43 

TO ee Mel ee a +48] +44) +22) +57] +28) +32) +30) +25) +69 
DRE Rade aed el +62} +39} +32} +40] +21] +35} +36) +28] +46 
LD re ois st cone +45} +35) +29) +29} +07) +38) +25) +29) +25 
ESN cre ones tortor: +37) +43] +18) +48] +13} +24] +19) +03) +31 
1 ee Seren pL rence +46} +31) +28} +31] +29} +30] +21) +48! +37 
TG rae aeegepietegs re +31; +19) +19} +45] +22) +31) +15) +04) +16 
635 Aa ee Recates +47) +40) +27) +54) +17) +40} +21) +21) +49 
UG Bia cease Seta ae +37) +37} +10} +03] +04} +18} +08) +25) +03 
PR es icons +52; +51) +12) —03) +20) +15} +20) +26) +16 
OPE Hea Sr +49} +47; +10} +07; +12} +31) +32} +03} +34 
DO mane tebe Se +28) +48) —04; +03) +16) +05} +15) +06) —04 
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INDEX 


Abilities Facilitating tables, 59 
primary mental, 2, 9 Factor 
reasoning, 2 D-, 88-89, 95 
visualizing, 1 deductive, 88-89, 95 
Abstraction tests, 11 (table), 13 I-, 86-87, 95 
Addition test, 11, 44, 82 inductive, 86-87, 95 


i i : M-, 85-86, 95 
American Council on Education, psycho- ) ie 
logical examination, 16 (table), 17 memory, 85-86, 95 


N-, 82, 94 
(table), 17-19 naming a, 79 
Anagrams test, 11, 30, 84 number, 82, 94 
Analysis of a score matrix by pairs of col- P-, 81-82, 94 
umns, 89 perceptual, 81-82, 94 
Areas test, 11, 42, 86 fi-, 88,95 
Arithmetical Reasoning test, 11, 47, 82, 88 Sakon pmneute 2°) 22 
: spatial, 79-80 
Block-counting test, 11, 30-31, 79 V-, 83-85, 94-95 
verbal relations, 84-85, 94 
Centroid matrix, 61-65 ad ihe 
. a aot 9) 
Centroid method, 6 word, 83-85 
Code Words test, 12, 49-50 a 
Factor analysis, indeterminacy in, 6 
Common factors, number of, 65-70 ; Seg ane 
‘ Factorial description invariant, 90-91 
Completion test, 11, 27-28, 80, 88 : 
; Factorial matrix, 4, 6 
Complexity, 92-93 Fact 
Composite tests, 93-95 eee 


interpretation of, 79-91 
Configuration number of, 5 


simple, 10, 71-73 number of significant, 66-70 
three-dimensional, 9 (figure) False Premises test, 12, 48-49, 84, 88 
Controlled Association test, 11, 26, 84 Figure Classification test, 11, 25-26, 79, 86, 


Copying test, 11, 41-42 88 
Correlation coefficient, 5 Figure Recognition test, 12, 54, 85 
Correlational matrix First and Last Letter test, 11, 29, 84 
centroid method of factoring a, 6 Flags test, 11, 33-34, 79 
Jae oo Form Board test, 11, 34-85, 79 
Cubes test, 11, 31-32, 79 Form tests, 11 (table) 
Freedom, degrees of, 5 
D-factor, 88-89, 95 Free Writing test, 57 
Deductive factor, 88-89, 95 Functions, nonlinear, 89 
ees a freedom of a scientific hypothe- Grammar test, 12, 57, 84 


Disarranged Sentences test, 11, 29, 80 Crap nical eet aedoteorationses 3/4 


Disarranged Words test, 11, 28, 84 Hands test, 12, 54-55, 79 
Distributions, forms of, 58 Hyperplane method, single, 73 
Division test, 11, 44, 82 


I-factor, 86-87, 95 


Empirical criterion, 66-70 Identical Forms test, 11, 40, 80 
Estimate of standard scores of an individual, Indeterminacy, 6-8 

95-98 Inductive factor, 86-87, 95 
Estimating test, 11, 44-45 Initials test, 12, 52-53, 85 
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Intercorrelations 
of fifty-seven tests, 58 _ 
frequency distributions of, 60 (table) 
of primary scores, 98-100 


Interpretation of the factors, 79-91 
Invariance of factorial description, 90-91 
Inventive Opposites test, 11, 27, 84 
Inventive Synonyms test, 11, 30, 84 
Isolation of primary traits, 10 


Linear function, 2 

Linearity, restrictions of, 89 
Lozenges A test, 11, 32-33, 79 
Lozenges B test, 11, 35-36, 79 


M-factor, 85-86, 95 


Matrix 
analysis of, by pairs of columns, 89 
centroid, 61-65 
correlational, 5 
factorial, 4, 6 
transformation, 76—78 


Mechanical Movements test, 11, 38-40, 88 
Memory factor, 85-86, 95 


Mental profiles, 92-102 
and vocational interests, 100-102 


Multiple-factor methods, 1 
Multiplication test, 11, 44, 62 


N-factor, 82, 94 
Naming of factors, 79 
Nonlinear functions, 89 


Norms 
comparative, on American Council test, 
21 (table) 
experimental group, 20 (table) 
University of Chicago Freshmen, 16 
(table), 17 (table), 17-19 


Number 
of factors, 5, 65 
of significant factors, 66 


Number Code test, 11, 42-43, 82 

Number factor, 82, 94 

Number-Number test, 12, 53, 85 

Number Series test, 11, 46, 86 

Number tests, 11 (table) 

Numerical Judgment test, 11, 46-47, 82, 88 
Numerical reasoning tests, 11 (table) 


Occupational preferences, 100-102 

Orthogonal reference frame, rotation of, 
' 71-78 

Orthogonal rotation of the axes, 75 

Orthogonal transformation, 75 


P-factor, 81-82, 94 
Pattern Analogies test, 12, 50-51, 80, 85 


PRIMARY MENTAL ABILITIES 


Perceptual factor, 81, 94 

Phi, values of, 66-70 

Picture Recall test, 12, 54, 80 

Primary abilities, 2, 10 
estimating scores, 95 


Primary factors 
pure measures of, 93 


Profiles, mental, 92-102 


Psychological examination 
American Council on Education, 16 
(table), 17 (table), 17-19 
comparison of norms, 21 (table) 


Punched Holes test, 11, 37-38 
Pure measures, 93 
Pursuit test, 11, 41, 79 


R-factor, 88, 95 

Rank, of correlational matrix, 6 
Reading I test, 11, 22-23, 84 
Reading II test, 11, 22-23, 84 
Reasoning ability, 2 

Reasoning test, 12, 47-48, 84, 88 
Regression, 95-98 

Reliabilities of the tests, 60 


Residuals, 61-65 
frequency distribution of, 62 (table), 63 
(table) 
standard deviation of, 64 (figure) 


Restrictions of linearity, 89 
Restrictive thinking, 88, 95 
Rhythm test, 12, 55-56 


Rotation 
graphical method of, 73-74 
orthogonal, of the axes, 75 
of the orthogonal reference frame, 71-78 


Rote-learning tests, 11 (table) 


S-factor, 79-80 
Sampling errors, 6 


Scores 
distribution of raw, 103-8 
estimating of, 95 
primary, intercorrelations of, 98-100 


Scoring formulas of the fifty-six tests, 11-12 
(tables) 

Simple configuration, 10, 71-73 

Simple structure, 10 

Single hyperplane method, 73 

Sound-grouping test, 12, 56, 79, 84 

Space-reasoning tests, 11 (table) 

Space tests, 11 (table) 

Spatial factor, 79-80 

Spelling test, 12, 57, 84, 88 

Subjects 


age distribution of, 16 (table) 
fifty-six psychological tests, 14-19 


INDEX 


Subtraction test, 11, 44, 82 
Surface Development test, 11, 36-37, 79 
Syllogisms test, 12, 51-52, 79 


Tables, facilitating, 59 
Tabular Completion test, 11, 44, 82, 86 


Test battery 
fifty-six psychological tests, 10, 11-12 
(table), 12-17 
subjects for, 14-19 
Test vector, 7 
Tests 
abstraction, 11 (table), 13 
administration of, 20-21 
combination of, into composite test, 93-95 
form, 11 (table) 
intercorrelations of, 58 
number, 11 (table) 
numerical reasoning, 11 (table) 
reliabilities of, 60 
rote-learning, 11 (table) 
space, 11 (table) 
space-reasoning, 11 (table) 
verbal, 11 (table) 
verbal-reasoning, 11 (table) 
West Point, 69 (table) 


121 


Tetrachoric correlation coefficients, 58-59 
Theme test, 12, 54 

Time limits for test battery, 11-12 
Transformation matrix, 75-77 


V-factor, 83-85, 94 

Vector, 7 

Verbal Analogies test, 12, 48, 80, 84 
Verbal Classification test, 11, 23, 79, 80 
Verbal-reasoning tests, 11 (table) 
Verbal relations factor, 84-85, 94 
Verbal tests, 11 (table) 

Visual factor, 79 

Visualizing ability, 1 

Vocabulary test, 12, 57, 80, 84, 88 
Vocational interests, 100-102 


W-factor, 84-95 

Word factor, 84-85 

Word-grouping test, 11, 24-25, 80, 84 
Word Knowledge test, 12, 57 
Word-Number test, 12, 52, 85 

Word Recognition test, 12, 53, 85 
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